producer

Reads a sample dataset (CSV or Parquet), maps it to the unified schema, and publishes messages into Kafka topic rides_raw with time compression.

Functions

parse_args()

get_config()

make_payload(row, ts_field, key_field)

Convert a pandas row into a JSON-serializable dict following schema.

sleep_scaled(curr, prev, speedup, min_sleep)

Sleep according to time compression.

main()

Module Contents

producer.parse_args()
producer.get_config()
producer.make_payload(row, ts_field, key_field)

Convert a pandas row into a JSON-serializable dict following schema.

producer.sleep_scaled(curr, prev, speedup, min_sleep)

Sleep according to time compression.

producer.main()