transformation.utils_helper =========================== .. py:module:: transformation.utils_helper Submodules ---------- .. toctree:: :maxdepth: 1 /api/transformation/utils_helper/io_hepler/index Functions --------- .. autoapisummary:: transformation.utils_helper.readFromDb transformation.utils_helper.writeToDb Package Contents ---------------- .. py:function:: readFromDb(session: pyspark.sql.SparkSession, conf: dict) -> pyspark.sql.DataFrame Read the currect untreated day data from the database to be transformed Args : - session (SparkSession) : the intial spark session with the db driver to use to read from database - cong (dict) : the dictionary that contain the connection parametres .. py:function:: writeToDb(df: pyspark.sql.DataFrame, conf: dict) Write cleaned DataFrame to the database :param - df: The cleaned dataframe we want to write to the database :type - df: DataFrame :param - conf: the dictionary that contain the connection parametres :type - conf: dict