ETL Process Sample

Each aspect of this process was self produced and implemented.

Sample Process Highlights:

    1. Takes 1-2 minutes depending on source row count
    2. One of the SQL tables had to sift through over 1 million rows during the insert / update part
    3. Changes to rows, columns, and tables were counted and recorded
    4. Potentential row errors were recorded
    5. Compared to previous method, process time improved by 90% while handling 5x the column count