Open to architecture & CDO conversations

Aniket Dwivedi

Solutions Architect, Chief Data Office · Data Governance · Data Engineering · AI Governance

Fifteen years turning messy enterprise data into something people — and now AI agents — can actually trust and act on. I work at the join between governance, engineering, analytics and architecture, because that is exactly where the value hides.

Pune, Maharashtra, IndiaOn-site · Hybrid · RemoteIndia · Europe · US teams
Aniket Dwivedi
15+
Years in data & analytics
$20M
Supply-chain savings identified
150+
Dashboards delivered globally
7
Industries served
15+
Professional certifications

The consolidated view

Everything I do, on one page.

Four disciplines around a single centre. Governance, engineering, analytics and AI are usually run as separate programmes — the value shows up exactly where they meet. Node size shows depth; the outer ring is the leadership layer that holds the four together. Hover any node, or filter by discipline.

Focus
Core — daily, hands-on Strong — regular delivery Working — applied on projectsEvery capability below is backed by shipped work — see open source and experience.

What I do

Four disciplines, one problem.

Each one is a job on its own. Run together, they are the difference between a number you can defend and a number you argue about.

Data engineering & platforms

Pipelines that are safe to re-run at 3am. Incremental ingestion with watermarks, SCD Type 2, declarative quality gates, and lakehouse foundations across Snowflake, Databricks and Microsoft Fabric — federated with Starburst/Trino where the data cannot move.

  • PySpark
  • Snowflake
  • Databricks
  • Fabric / OneLake
  • Data Vault 2.0
  • Python · Alteryx

Data governance that operates

Federated ownership, stewardship and data products with named owners and SLAs. Councils that decide, working groups that execute. Glossary, lineage and quality wired through Collibra with the teeth to stop a load — not living in a slide deck.

  • Collibra
  • DAMA-DMBOK
  • Data quality
  • Lineage · Metadata
  • MDM
  • CDO operating model

Business intelligence at scale

Certified data sources, standardised KPIs, row-level security and tuned extracts — governed self-service instead of conflicting numbers. Plus the unglamorous half: administering a 500+ workbook estate, rationalising it, and migrating legacy Cognos and Excel onto something maintainable.

  • Tableau Cloud · Server
  • Tableau Pulse
  • Power BI
  • Semantic layer
  • Row-level security
  • TabPy · Hyper API

Agentic AI, governed

Agents built in Agent Studio with Prompt Builder — topics, actions and guardrails — grounded through Data 360 over Snowflake, so leadership can ask a question in plain language and get an auditable answer. An agent is exactly as trustworthy as the certified datasets, entitlements and lineage beneath it.

  • Agentforce
  • Data 360
  • Grounding · RAG
  • Responsible AI
  • Einstein Trust Layer
  • Evaluation harnesses

“Every organisation wants AI agents acting on its data. Very few have data an agent should be trusted with. The unglamorous work — ownership, stewardship, quality rules, lineage — is suddenly the thing that decides whether AI helps or quietly multiplies your existing errors.”

— and the reason all four disciplines above are one job, not four.

How it fits together

The layer under the dashboard.

Three diagrams for the three questions I get asked most: what does the platform look like, who is actually accountable, and how did someone end up doing all four of these things.

Reference architecture — governed data foundation to agentic consumption

The shape I build towards. Note where governance sits: not a stage in the pipeline, a rail underneath all of it. That is the whole argument.

Built in anger across asset management, banking and manufacturing estates. The five-box row is the part everyone draws; the blue rail is the part that decides whether any of it survives an audit.

The trust chain — who is actually accountable

Governance thrives when roles are genuinely defined. Owners, stewards, custodians and consumers each hold a distinct piece; when one is vacant, the chain breaks there and only there.

The five-pillar framework I presented at a governance forum — people, data, data stores, processes, governance — turns on exactly this. The point that landed hardest with that audience: governance thrives when roles are genuinely defined.

Fifteen years, one direction of travel

Each layer starts when I moved into it and then just keeps going. The direction of travel is downward — analysis and visualisation first, then analytics, then the engineering, architecture and governance underneath them — but nothing above ever gets handed back.

Not one of these has ever been handed back. I still gather the requirements and build the dashboard, still write the pipeline, still sign the architecture — which is the whole argument for one person holding governance, engineering and BI at once rather than passing a number between three teams and hoping. The through-line has not changed in fifteen years: make the number defensible, then make it easy.

Experience

Fifteen years, nine roles.

From Tableau developer to Chief Data Office. The titles changed; the job — making data trustworthy enough to decide on — did not.

Dec 2024
— Present
Current

Assistant Vice President, Chief Data Office

DWS Group

Pune, India · Hybrid

Defining target-state BI and data architecture, turning business and regulatory requirements into governed, decision-ready reporting. Solutions Architect working deep in the Salesforce ecosystem.

  • Built the “House of Data” governance-reporting layer — one consistent view of KPIs, ownership and delivery across the CDO
  • Delivered certified Tableau dashboards and standardised KPIs for senior risk, controls and investment stakeholders
  • Piloting Agentforce agents grounded via Data 360 over Snowflake for auditable, natural-language governance answers — the pattern is open-sourced in governed-ai-grounding
  • Architected governed foundations across Azure, Microsoft Fabric and Snowflake, federated with Starburst/Trino and integrated with Collibra
  • Delivered Python-in-Tableau analytics — TabPy scoring, k-means clustering, Hyper API extracts
Aug 2023
— Nov 2024

Independent BI & Data Governance Consultant

Self-employed

Maharashtra, India · Remote

Governed Tableau architecture, migration and reporting for asset management, banking, healthcare and product-engineering clients — each engagement run end to end.

  • Advised on Tableau Server-to-Cloud migration, Tableau Pulse and agentic-AI adoption for large estates — the playbook is public as tableau-architecture-playbook
  • Salesforce (via Aditi Consulting): tested and validated next-generation Tableau — Cloud, Pulse, Agentforce
  • Healthcare (via Escalent): governed financial dashboards across revenue, cost and margin
Dec 2022
— Jul 2023

Associate Vice President

JPMorgan Chase & Co.

Bengaluru, India · Hybrid

Tableau Design Architect delivering credit-risk analytics for Consumer & Corporate Banking in a highly regulated environment.

  • Architected analytics for credit-card exposure, delinquency, vintage and portfolio risk
  • Built governed Snowflake foundations and Python/Alteryx ETL across Oracle and Big Data backends — the connectivity layer generalised into pydb-connect
  • Strengthened reporting controls and data readiness for analytics and AI/ML use cases
Jan 2022
— Dec 2022

Senior Process Manager

eClerx

Pune, India · Remote

Led delivery for retail and software reporting across multiple concurrent workstreams.

  • Campaign analytics across 50+ airport locations for a U.S. airline, Salesforce-embedded with role-based access
  • Migrated 30+ dashboards from Cognos to Tableau with KPI mapping, validation and sign-off
  • Embedded data-quality checks that reduced production issues
Jan 2018
— Nov 2021

Senior Data Specialist — BI Program Lead & Architect

Emerson Automation Solutions

Pune, India · On-site

Owned the full BI lifecycle for global supply chain and procurement in Emerson's Core Data Analytics CoE.

  • Delivered 150+ Tableau dashboards globally as Data-as-a-Service with reusable governed sources
  • Administered global Tableau Server — 500+ workbooks, 80+ extracts, migrations and tuning
  • Governance, MDM and anomaly monitoring that helped identify $20M in supply-chain savings
  • Modelled SAP procurement data — purchase orders, goods receipts, vendor master; the Data Vault treatment is public as sap-data-vault-2
  • Built a live global ports & shipping-routes command centre during COVID-19 — Python and REST-API pipelines feeding real-time route recommendations across sea, air and land
  • Led and mentored the BI developer team; set the CoE's reporting and governance standards
Jul 2016
— Dec 2017

Senior Research Analyst

Accenture

Pune, India · On-site

Predictive analytics for a major U.S. insurer.

  • Python predictive-risk models forecasting loss patterns from claim, location and climate data
  • Insurance KPIs across lines of business on Oracle/DB2 with geo-coded dashboards
  • GDPR-compliant predictive platform; A/B testing that improved customer loyalty by 14%
Sep 2015
— Jun 2016

Data Visualisation / BI Developer

Tata Consultancy Services

Pune, India · On-site

Tableau trainer and developer building dashboard capability for customer-experience programmes.

  • Delivered Tableau training and enablement, raising design standards across analyst and developer teams
  • Customer-satisfaction and sentiment analytics on Teradata for service-recovery programmes
Jan 2012
— Jul 2015

Tableau Developer / Business Analyst

DenuoSource India

Hyderabad, India · On-site

Retail and pharma analytics for Walmart and Office Depot.

  • Migrated 25+ Cognos reports to Tableau on Teradata with managed refreshes and permissions
  • Python dynamic reports tracking competitor price indices to drive dynamic pricing
  • Loyalty, customer-segmentation and market-basket analytics with store-traffic prediction
Jan 2011
— Dec 2011

Freelance Data Analyst

GateForum

Jabalpur, India · Remote

Market and competitor research in the equity crowdfunding sector — SWOT analysis, survey design and insight-driven recommendations that shaped early-stage investment approaches.

Certifications

Credentials in active use.

Each of these maps to something on the job — not collected for the wall. Badge artwork is the real credential where I hold it. Cards link to the issuing programme; the Microsoft credential links to my verified transcript.

DAMA CDMP Practitioner badgeCDMP Data Governance & Stewardship specialisation badgeCDMP Data Warehousing & BI specialisation badge
DAMA International
CDMP Practitioner
Plus specialisations in Data Governance & Stewardship and Data Warehousing & BI. The governance backbone.
Issuer
TOGAF Enterprise Architecture Practitioner badge
The Open Group
Enterprise Architecture Practitioner
Architecture method and framework — target-state design that somebody actually signs.
Issuer
DATABRICKSDE · PROFESSIONAL
Databricks
Certified Data Engineer Professional
Lakehouse pipelines, Delta, Unity Catalog and production-grade PySpark.
Issuer
Snowflake SnowPro Core badge
Snowflake
SnowPro Core
Warehouse design, performance, security and governance on Snowflake.
Issuer
DP-600MICROSOFT
Microsoft
Fabric Analytics Engineer Associate
Fabric, OneLake and the semantic layer — verified on Microsoft Learn.
✓ Verify
AGENTFORCE · SPECIALIST
Salesforce
Agentforce Specialist
Agent Studio, Prompt Builder, topics, actions and guardrails.
Issuer
DATA 360CONSULTANT
Salesforce
Data 360 Consultant
Data Cloud — ingestion, harmonisation, identity resolution, activation.
Issuer
TABLEAU5× CERTIFIED
Salesforce · Tableau
Architect · Data Analyst · Desktop Specialist
Visualisation, semantics and server administration at estate scale.
Issuer
CRMANALYTICS · EINSTEIN
Salesforce
CRM Analytics & Einstein Discovery
Predictive analytics and story-driven modelling inside the CRM estate.
Issuer
IAPP AI Governance Professional badge
IAPP
AI Governance Professional
Model risk, transparency and accountability — DAMA-style controls extended to AI.
Issuer
Certified SAFe Agilist (AI-Empowered) badge
Scaled Agile
Certified SAFe Agilist
Delivery at programme scale, under regulatory deadlines.
Issuer
GOOGLECLOUD CERTIFIED
Google Cloud
Google Cloud Certified
Cloud data engineering and analytics on GCP.
Issuer
BCSBUSINESS ANALYSIS
BCS · Chartered Institute for IT
Certified Business Analyst
Requirements, BRD/FRD authoring and stakeholder analysis.
Issuer

Skills & stack

What I actually work in.

The full list behind the capability map. Highlighted items are the ones I am hands-on in this quarter, not ones I touched once in 2017.

Data engineering & pipelines 14

Hands-on since 2016 · production-grade since 2018

  • Python
  • PySpark
  • SQL · PL/SQL
  • pandas · NumPy
  • ETL / ELT
  • Incremental & watermarks
  • SCD Type 2
  • CDC
  • Data-quality engines
  • Alteryx
  • Tableau Prep
  • REST API ingestion
  • Scrapy
  • Git

Platforms, lakehouse & cloud 14

Multi-cloud — Azure primary, Snowflake as the constant

Governance & data management 12

The centre of gravity — CDMP Practitioner, Collibra in production

  • Collibra
  • DAMA-DMBOK
  • Data quality frameworks
  • Metadata & lineage
  • Data stewardship
  • Data products & SLAs
  • Active metadata
  • Policy-as-code
  • MDM
  • CDO operating models
  • Regulatory reporting
  • Audit evidence

Analytics & BI 12

Since 2012 · 5× Tableau certified · 500+ workbook estates

AI, ML & agentic 11

Predictive since 2016 · agentic since 2024 · IAPP AIGP

  • Salesforce Agentforce
  • Data 360 / Data Cloud
  • Grounding & RAG
  • Responsible AI controls
  • Prompt Builder
  • Einstein Trust Layer
  • Evaluation harnesses
  • Predictive modelling
  • k-means clustering
  • Sentiment analysis
  • scikit-learn · R

Architecture, leadership & delivery 11

The layer that wraps the other four

  • TOGAF
  • Target-state architecture
  • Governance councils
  • Data Vault 2.0
  • SAFe · Agile
  • Jira · Confluence · RAID
  • Stakeholder management
  • BRD / FRD authoring
  • Team mentoring
  • Vendor & tool selection
  • Public speaking

Where I have delivered

Data platforms are only as good as the domain understanding behind them.

🏛 Asset & investment management

CDO reporting, AUM and net-flow metrics, mandate and benchmark data, investment-risk and controls reporting, regulatory (FED) submissions.

🏦 Banking & credit risk

Credit-card and corporate credit-risk estates — exposure, delinquency, vintage, loss forecasting and portfolio-risk reporting.

📦 Procurement & supply chain

Purchase-to-pay and SAP procurement data, inventory, logistics, vendor performance and on-time-delivery analytics.

🛒 Retail & omnichannel

Market-basket analysis, cross-sell and loyalty segmentation, competitor price indices for dynamic pricing, store-traffic prediction.

🛡 Insurance

Policy and claims analytics, predictive risk modelling from claim, location and climate data.

Healthcare, energy & telecom

Revenue, cost and margin dashboards; operational and smart-meter style data; network and customer-experience reporting.

Open source

Everything above, in runnable form.

Eight reference implementations of the patterns on this page. All of it was executed before it was published — the pipelines run, the tests pass, and the numbers in each README came from a real run rather than an estimate. Clone any of them and run pytest.

8 public repositories · ~40,000 lines · 255+ tests passing · MIT licensed
github.com/aniketdwivedi7388
View the profile
trade-to-reportNew

A banking domain data architecture worked end to end. Two functions read the same book of derivatives and report four different numbers — none of them wrong. One canonical model, a finance lens and a risk lens, a published reconciliation, and 42 data standards, ten of them enforced by a linter that fails the build.

regulatory-reportingfinrepdata-lineagebanking
Conformance linterDuckDB · one commandMIT
sap-data-vault-2

A working Data Vault 2.0 over real SAP procurement tables — LFA1, EKKO, EKPO, EKBE, MARA. Four source systems, hubs / links / multi-source satellites, hash keys and diffs, PIT + bridge, business vault and star marts. Reproduces the bug where SAP purchase-order numbers collide across instances because they are not globally unique.

data-vault-2sapduckdbdata-modeling
32 testsRuns in 60s on DuckDBMIT
lakehouse-pipeline-patterns

Medallion architecture in PySpark that runs on a laptop with no cluster: incremental ingestion with watermarks, SCD Type 2, a declarative YAML data-quality engine and as-of dimensional joins. Includes the future-dated row that poisons a watermark so a job silently ingests nothing, forever.

pysparkmedallion-architecturedata-qualityscd2
23 testsNo cluster requiredMIT
pyspark-rdd-internals

What actually happens on the cluster: map-side combine, shuffle bytes, partitioning, caching and skew — each one measured, then shown as the DataFrame/SQL equivalent you should actually ship. A lab, not a lecture.

apache-sparkperformance-optimizationdistributed-systems
28 testsReal measurementsMIT
pydb-connect

Config-driven connectivity across MySQL, Postgres, Oracle, Snowflake, SQLite and ADLS behind one interface. Secrets never in the repo, connections that always close, bulk loads that batch, retries that classify errors properly.

pythonsnowflakeazure-data-lakeetl
172 testsImports with zero driversMIT
data-governance-toolkit

The working artefacts of a governance function — DAMA-DMBOK aligned glossary templates, a 61-rule quality catalogue with a runnable YAML-driven engine, stewardship operating model, RACIs, a CDO KPI framework and a lineage guide. Includes the suite that reported 100% pass on broken data because NULL > 0 is NULL, not false.

data-governancedama-dmbokdata-lineagecdmp
Runnable DQ gateDAMA-DMBOK alignedMIT
governed-ai-grounding

Grounding enterprise AI agents in governed data — retrieval quality is a data-governance problem, not a prompting problem. Reference architecture, the semantic layer as a metric contract, guardrail patterns, AI controls mapping and a runnable evaluation harness.

ai-governanceragsemantic-layerresponsible-ai
Runnable eval harnessCI-readyMIT
tableau-architecture-playbook

Enterprise Tableau standards that keep a large estate healthy: certified data sources, row-level security patterns, performance tuning, content rationalisation, Server→Cloud migration runbooks, plus read-only estate-audit, Hyper API and TabPy scripts.

tableaubi-architecturerow-level-securitytabpy
Read-only audit toolingServer & CloudMIT

Three of these reproduce failure modes I have actually hit and fixed. Reproducing a bug is worth more than describing one — and it is the fastest way for you to check whether I know what I am talking about.

Knowledge base

What I'm learning, in the open.

I keep a running, structured record of every session of the cloud and data-engineering programme I'm working through — appended into living documents rather than scattered files, so it stays readable end to end. Below is the map of it. Where a topic is worth proving, it becomes a repository.

18Sessions captured
24Hours of material
7Topic areas
282Teaching points
64Diagrams drawn
73Pages of notes
Running record — last session 10 August 2026. Each area lists the sessions behind it.See what became code →

Writing & speaking

Thinking out loud.

Selected pieces on governance, BI and the agentic era — with the reach they earned. Published on LinkedIn, where I also post most weeks.

“Agents are only as trustworthy as the data beneath them. Ingest high-quality, well-governed data and the agentic layer becomes genuinely reliable. Skip that foundation, and you've simply automated your data problems.”

— from the modern data architecture series

Get in touch

Let's talk data.

Open to conversations on data governance, data engineering, BI leadership, AI governance and enterprise data architecture — roles, advisory work, collaboration or speaking.

Particularly interested in

  • Data platform & architecture leadership — Data Architect, Principal / Lead Data Engineer, Data Platform Lead
  • Chief Data Office & governance transformation — operating models, DAMA-aligned frameworks, Collibra adoption
  • Enterprise BI at scale — Tableau architecture, migration and estate rationalisation
  • Agentic AI on governed data — and where the governance actually has to sit

Based in Pune, working with teams across India, Europe and the US. On-site, hybrid or remote.