Technology · Data and analytics
Appears in 3 cases.
Data
A local Python pipeline that collects publicly visible Instagram job-vacancy posts across Indonesia's 38 provinces, reads the flyer images with OCR, extracts and normalises the vacancy fields, deduplicates within and across runs, and stores structured output as JSON, JSON Lines, CSV, and SQLite.
Data
A five-layer data platform: CSV batches land in S3 and user events stream through Kinesis; Glue, EMR, Step Functions, and EventBridge transform and orchestrate; Redshift, DynamoDB, and S3 store history, real-time metrics, and the lake; Lambda behind API Gateway serves five endpoints protected by WAF and API keys; a dashboard on Amplify shows GMV, sales, funnel, and ML segments.
IoT
An ESP32 reads temperature and humidity from a DHT22 and publishes JSON over MQTT to AWS IoT Core, authenticated with an X.509 device certificate over TLS. Node-RED subscribes to the topic, applies the data logic, and renders gauges, a 24-hour trend, and threshold alerts on a dashboard that is reachable from anywhere.