Unterschiede

Hier werden die Unterschiede zwischen zwei Versionen angezeigt.

--- opensearch [2025/03/25 01:02]
+++ opensearch [2025/03/27 11:49] (aktuell)
@@ Zeile 1: / Zeile 1: @@
+Siehe auch [[ElasticSearch]] (z.B Scripte, API, etc. sind identisch). [[Wazuh]] verwendet [[OpenSearch]].
+=====Installation=====
+Run a local cluster
+<code>
+docker run --rm -p 9200:9200 -p 9600:9600 -e "discovery.type=single-node" opensearchproject/opensearch:2.6.0
+</code>
+Create a python script
+<code python>
+from opensearchpy import OpenSearch
+client = OpenSearch(
+    hosts = [{"host": "localhost", "port": 9200}],
+    http_auth = ("admin", "admin"),
+    use_ssl = True,
+    verify_certs = False,
+    ssl_assert_hostname = False,
+    ssl_show_warn = False,
+)
+client.info()
+</code>
+Get some random data for e.g [[https://www.kaggle.com/datasets/jrobischon/wikipedia-movie-plots|wikipedia-movie-plots]]. Read the data into a pandas array.
+<code python>
+import pandas as pd
+df = (
+    pd.read_csv("wiki_movie_plots_deduped.csv")
+    .dropna()
+    .sample(5000, random_state=42)
+    .reset_index(drop=True)
+)
+</code>
+Create an index
+<code python>
+body = {
+    "mappings":{
+        "properties": {
+            "title": {"type": "text", "analyzer": "english"},
+            "ethnicity": {"type": "text", "analyzer": "standard"},
+            "director": {"type": "text", "analyzer": "standard"},
+            "cast": {"type": "text", "analyzer": "standard"},
+            "genre": {"type": "text", "analyzer": "standard"},
+            "plot": {"type": "text", "analyzer": "english"},
+            "year": {"type": "integer"},
+            "wiki_page": {"type": "keyword"}
+        }
+    }
+}
+response = client.indices.create("movies", body=body)
+</code>
+Push the data into the index
+<code python>
+for i, row in df.iterrows():
+    body = {
+            "title": row["Title"],
+            "ethnicity": row["Origin/Ethnicity"],
+            "director": row["Director"],
+            "cast": row["Cast"],
+            "genre": row["Genre"],
+            "plot": row["Plot"],
+            "year": row["Release Year"],
+            "wiki_page": row["Wiki Page"]
+    }
+    client.index(index="movies", id=i, body=body)
+</code>
+More data in a bulk
+<code python>
+from opensearchpy.helpers import bulk
+bulk_data = []
+for i,row in df.iterrows():
+    bulk_data.append(
+        {
+            "_index": "movies",
+            "_id": i,
+            "_source": {
+                "title": row["Title"],
+                "ethnicity": row["Origin/Ethnicity"],
+                "director": row["Director"],
+                "cast": row["Cast"],
+                "genre": row["Genre"],
+                "plot": row["Plot"],
+                "year": row["Release Year"],
+                "wiki_page": row["Wiki Page"],
+            }
+        }
+    )
+bulk(client, bulk_data)
+</code>
+Count the inserted data
+<code python>
+client.indices.refresh(index="movies")
+client.cat.count(index="movies", format="json")
+</code>
+Search the data
+<code python>
+resp = client.search(
+    index="movies",
+    body={
+        "query": {
+            "bool": {
+                "must": {
+                    "match_phrase": {
+                        "cast": "jack nicholson",
+                    }
+                },
+                "filter": {"bool": {"must_not": {"match_phrase": {"director": "tim burton"}}}},
+            },
+        },
+    }
+)
+resp
+</code>
+Remove documents
+<code python>
+client.delete(index="movies", id="2500")
+</code>
+Delete the index
+<code python>
+client.indices.delete(index='movies')
+</code>

MBCDN

Benutzer-Werkzeuge

Webseiten-Werkzeuge

Unterschiede

Seiten-Werkzeuge