Yesterday at work, I was able to construct a data flow using SQL (via SSIS), a batch file, a Python program, and Tableau. This method will be automated (with exception of kicking off the batch file) on a weekly basis.
Essentially, all the alerts from prior week will be pulled, scrubbed, and used to create Tableau reports.
The break down.
First Process: SSIS
- The SSIS job runs weekly, around 5 a.m. Monday mornings. I have a SQL job pulling the last 7 days of alerts from the table.
- This data is giving in a text file, provided on a local S drive.
Second Process: Batch File
When I come into work that morning, I kick off the batch file.
- The batch file pulls the provided file into my local PC.
- The Python program cleans (Scrubs) the data, reformatting it to a more usable CSV file. It also applies a date/time in the filename. This way, I will always maintain a weekly data file without it overwriting.
Third Process: Tableau
- Now I can convert the CSV file into an Excel, which is used in Tableau.
- This allows me to construct visual reports. With these, we can track alerts to ensure a more proactive approach to issues. This also allows us to provide a view of reoccuring issues, Ect.
Matt Cole has high regard for knowledge share. He has a desire to share critical thinking and information. With a Masters in Information Technology and a wide array of certifications, while not working full-time, he wishes to knowledge share through providing insight, information organization, and critical thinking skills.
#KnowledgeShare | Matt Cole | #infobyMattCole
