DATA / AI WORKFLOWS

Data Analytics & AI-Augmented Technical Workflows

Applied data-analysis methods and generative AI as professional productivity tools for technical research, troubleshooting, scripting, documentation, analysis, and rapid prototyping.

Active Professional DevelopmentData Analytics / AI-Augmented Technical PracticePublic case study

Overview

Developed hands-on data-analysis and AI-augmented technical workflows as part of continuous professional development and modern IT practice.

Applied Uses

  • Technical research and solution exploration.
  • Troubleshooting and log/error analysis.
  • Scripting and workflow prototyping.
  • Technical documentation and process development.
  • Data analysis and structured problem solving.
  • Prompt engineering for repeatable professional workflows.

Professional Control

AI-generated suggestions are independently reviewed, tested, and validated before implementation, with attention to security, privacy, confidentiality, and operational requirements.

Detailed Project Scope

Build a traceable analytics case study that helps readers follow a dataset from initial inspection through reliable conclusions. The current portfolio example uses a healthcare-related dataset to illustrate data quality, transformations, statistical interpretation and reproducible reporting, while AI assistance is treated as a reviewed engineering aid rather than a source of unverified answers.

Technical approach and validation

The work will use a data dictionary, transformation log, staged source files and reproducible notebooks. Each finding must be traceable to an input, calculation, analytical decision and validation check. Before publishing charts or claims, the methodology will distinguish descriptive observations from causal conclusions and explain missing data, leakage risks and limitations.

Project Roadmap

The roadmap below tracks the case study from research framing through repeatable reporting. DA-01 through DA-03 are now In Progress based on verified Excel / Power Query evidence. Later Python, SQL and reporting phases remain planned until their outputs have been run and checked.

DA-01 — Research question and dataset inventory Completed · Validated

  1. State a focused question and define target measures
  2. Review field names, types, units and documentation
  3. Record provenance, licensing and confidentiality constraints

Verified deliverable: Dataset intake, provenance, 50-field structure, encounter-level grain, and baseline record counts documented.

DA-02 — Excel data profiling Completed · Validated

  1. Count records and inspect data types, nulls and duplicates
  2. Identify categorical ranges, outliers and impossible values
  3. Create a baseline profiling log with reproducible screenshots

Verified deliverable: Full-dataset profiling and documented data-quality findings.

DA-03 — Cleaning and transformation Completed · Validated

  1. Define deterministic rules for missing or inconsistent values
  2. Preserve an untouched raw dataset and version transformations
  3. Reconcile row counts and key measures after each cleaning operation

Verified deliverable: Audited UTF-8 cleaned extract, eight documented transformations, 12/12 Excel reconciliation checks, and 33/33 independent export QA checks.

DA-04 — Python exploratory analysis Planned

  1. Build a Jupyter/Pandas ingestion and validation notebook
  2. Compute descriptive measures and segment the population appropriately
  3. Create charts with clear denominators, labels and uncertainty notes

Expected deliverable: Reviewed notebook and explanatory plots.

DA-05 — SQL analysis Planned

  1. Load the validated subset into a documented SQL schema
  2. Write aggregation and cohort queries for selected questions
  3. Cross-check SQL outputs against independent calculations

Expected deliverable: SQL scripts and reconciliation table.

DA-06 — Reporting and interpretation Planned

  1. Select a small set of decision-relevant visualizations
  2. Draft a Power BI or equivalent dashboard after validated measures exist
  3. Document interpretations, constraints and alternative explanations

Expected deliverable: Dashboard draft and findings narrative.

DA-07 — AI-assisted workflow validation Planned

  1. Record where AI was used for research or code suggestions
  2. Review output for correctness, security and reproducibility
  3. Compare human-verified results with proposed automation

Expected deliverable: AI-use statement and quality-control checklist.

DA-08 — Final case study and repeatability Planned

  1. Publish sanitized evidence and downloadable non-sensitive methodology
  2. Link each chart to its source method and validation notes
  3. Document lessons learned and potential next analytical questions

Expected deliverable: Evidence-based published analytics case study.

Excel Data Quality & Cleaning — Completed

QA checks passed · Excel / Power Query data preparation completed

A traceable preparation workflow for the historical Diabetes 130-US Hospitals dataset is now complete. Using Excel Power Query, the project profiled 101,766 hospital encounters across 50 source fields, preserved the untouched source, and applied eight documented transformations: seven source ? missing-value markers plus one Unknown/Invalid gender category. Encounters were not deleted and unsupported values were not imputed.

101,766encounter records independently validated
50source fields with structure preserved
12/12Excel reconciliation checks passed
33/33cleaned-export QA checks passed
11.16%historical encounters labeled readmission <30 days

Dataset integrity and reconciliation

The validated export contains 101,766 unique encounter IDs and 71,518 unique patient IDs, with zero duplicate encounter IDs. A row-by-row, cell-by-cell comparison against the original source found zero unexpected differences after the eight intended replacements. A separate Python script was used only as an independent export-integrity check; Python exploratory analysis remains a later roadmap phase.

Repeat encounters: 16,773 patients have more than one encounter. That is not equivalent to a 30-day readmission and is retained as legitimate encounter-level history.

Aggregate missing-data profile for eight cleaned fields across 101,766 encounters, led by weight at 96.86 percent missing, medical specialty at 49.08 percent, and payer code at 39.56 percent.
Aggregate missing-data profile after source placeholders were normalized. Literal source category None in A1C and glucose fields is deliberately not treated as null.
Aggregate readmission-label distribution: 54,864 encounters labeled NO, 35,545 labeled greater than 30 days, and 11,357 labeled less than 30 days.
Observed historical readmission labels at the encounter level. The 11.16% <30 share is descriptive, not a predictive or causal result.

Excel quality-control evidence

Sanitized Excel Power Query quality-control table showing 12 aggregate validation metrics, with observed and expected values matching and all checks marked PASS.
Sanitized aggregate QA view: all 12 final Excel reconciliation checks passed. No row-level patient or encounter identifiers are shown in this preview asset.

Baseline outcomes and limitations

Readmission labels are preserved as recorded: 54,864 NO, 35,545 >30, and 11,357 <30. The <30 category represents 11.16% of encounters. This is a descriptive baseline only.

Source-recorded weight is absent for 98,569 encounters (96.86%), medical_specialty for 49,949 (49.08%), and payer_code for 40,256 (39.56%). The source-coded None labels were preserved as categories for A1C (84,748; 83.28%) and glucose testing (96,420; 94.75%), rather than converted into clinical measurements.

Next analytical phase

DA-04 begins with Jupyter/Pandas exploratory analysis, followed by SQL validation, Power BI reporting, a light Tableau comparison, documented AI-review practices, and final integrated interpretation. No EDA finding, prediction, causal effect, SQL dashboard result, model accuracy, or clinical-efficacy claim is presented as completed.

Data source: UCI Machine Learning Repository — Diabetes 130-US Hospitals for Years 1999–2008. Historical public research data.

Project Updates

Excel / Power Query preparation phase completed

The initial Excel data-quality and cleaning phase is complete and independently reconciled. The workflow preserved 101,766 encounters and all 50 source fields while applying exactly eight intended replacements: seven literal missing-value markers and one invalid gender category.

Validation: 12/12 final Excel reconciliation checks passed, 33/33 independent cleaned-export QA checks passed, duplicate encounter IDs remained at zero, and a cell-level comparison found zero unexpected differences from the original source beyond the intended transformations.

Baseline: 11,357 encounters carry the historical <30 readmission label (11.16%), 35,545 carry >30, and 54,864 carry NO. These are descriptive encounter-level labels, not predictive or causal findings.

Next planned update: Begin DA-04 with reproducible Jupyter/Pandas exploratory analysis using the validated cleaned export. SQL, dashboard reporting, and integrated interpretation remain planned.

Scope note: This is an independent learning and portfolio analysis of historical public data. It is not presented as a clinical prediction tool or current clinical guidance.