producer¶
Reads a sample dataset (CSV or Parquet), maps it to the unified schema, and publishes messages into Kafka topic rides_raw with time compression.
Functions¶
|
Convert a pandas row into a JSON-serializable dict following schema. |
|
Sleep according to time compression. |
|
Module Contents¶
- producer.parse_args()¶
- producer.get_config()¶
- producer.make_payload(row, ts_field, key_field)¶
Convert a pandas row into a JSON-serializable dict following schema.
- producer.sleep_scaled(curr, prev, speedup, min_sleep)¶
Sleep according to time compression.
- producer.main()¶