Python script that will update S3 file paths in Iceberg metadata files (metadata.json + AVRO)

Example using the Iceberg register_table command with AWS Glue and Glue Data Catalog

Configure any version of Apache Iceberg with AWS Glue by installing Iceberg from JAR files

CloudFormation stack automating the deployment of recomended cloudwatch alarms for OpenSearch

Access the OpenSearch dashboard of a domin deployed in a private subnet via. a Nginx Proxy

Connect a locally hosted OpenSearch dashboard server to an Amazon OpenSearch hosted domain

Example covering how to adjust the refresh interval on an OpenSearch index

Example covering how to set an OpenSearch index to read only. A common prerequisite for performance tuning tasks

PySpark script to aggregate small parquet files in a prefix into larger files. Designed to be run on AWS Glue

Example covering ideal shard size + how to adjust # of primary, replicate shards for an index

Tokenize and convert sample text data into vectors using BERT. Load the vector representation of the text to OpenSearch and use kNN for semantic search

Example to help understand how to use hugging face sentance_transformers to encode searchable text into embeddings AND how to use cosine similarity search to determine similarity between a search p…

OpenSearch Neural Search example. Load BERT to OpenSearch and create embeddings as data is indexed. Use the embedding to preform vector search

Example to help understand how the BM25 term based ranking model works in search applications

Authenticate with OpenSearch via. IAM Sigv4

Example python code manipulating the OpenSearch RESTful API for user, role and permission management

Resources from an virtual tech talk / workshop - Set Up and Use Apache Iceberg Tables on Your Data Lake

CloudFormation to automate the deployment of the required IAM roles for AWS Security Lake

Example API calls to set up OpenSearch (via. Python) for anomaly detection, cross cluster replication, load sample data ...

Examples explaining how deletes work in OpenSearch

Python script to process emails saved with .msg file extension

Logstash log collection, parsing example

Apache Icebery examples designed to be run on AWS Elastic Map Reduce (EMR) via. EMR Studio or EMR Notebooks

Example Jupyter notebook for EMR Studio

Apache Hudi examples designed to be run on AWS Elastic Map Reduce (EMR) via. EMR Studio or EMR Notebooks

PySpark code samples designed for AWS Glue

Log data -> Kafka (MSK) - Lambda -> OpenSearch - Anomaly Detection

Helps explain how Flink handles late arriving data and the effects on message order

Script to collect GitHub repository views and unique visits

Prebuilt demo of Amazon DataZone using fake data for topics in the financial services industry