Abhishek

Tech Lead India
10 yrs experienceEnglish Fluent
AI Summary
Skills
Aws6yETL Pipelines8yAI Agents2y
Secondary skills
ClaudeBusiness AnalysisDatabricksPython
Experience
Tech Lead
Jan 2023 – Present
Planned and built end to end data pipeline for streaming data for Labs using eventhouse in Microsoft Fabric. Architectured BU workspace isolation with one lake shortcut, RLS/CLS enforcement for secure data consumption. Explored agentic AI usecase for Fabric – automated pipeline status updates to stakeholders via team. Evaluated data consumption strategies (Power BI direct Lake, GraphQL API).
Agentic AIAnalyticsApiAwsBusiness AnalysisBusiness IntelligenceData WarehouseKafkaPower BIPowershellPysparkPythonRedshiftS3SNSSqlEc2GraphqlUnix
Tech Lead
Jan 2022 – Dec 2022
Designed real-time ingestion pipelines using Apache Kafka to stream instrument data from lab analyzers and LIMS systems, enabling sub-minute visibility into assay results across 10+ lab sites. Designed streaming feature pipelines using Kafka Streams to deliver real-time patient or trial data signals to ML models. Worked closely with stakeholders to assess current-state systems and support structures. Planned and strategized the redesign of cloud architecture based on in-depth analysis and a clear understanding of system requirements.
KafkaApache KafkaArchitectureApache
Tech Lead
Jan 2021 – Dec 2021
Worked closely with business analysts and stakeholders on current-state assessments to understand existing data flows and support structures. Planned and strategized the redesign of cloud architecture based on in-depth analysis and a strong understanding of system requirements.
ArchitectureBusiness Analysis
Tech Lead
Jan 2020 – Dec 2020
Managed an 11-member migration/DevOps team to complete data migration from an on-premises Oracle legacy database to AWS Aurora PostgreSQL Serverless using AWS DMS. Completed a PoC and planned migration of database objects using AWS Schema Conversion Tool (SCT). Improved performance by tuning parameters and flattening hierarchical views in PostgreSQL, resulting in a 70% improvement in query results. Configured endpoints and AWS DMS services for full load and CDC. Also configured tasks for reverse replication from Aurora PostgreSQL to Oracle. Planned and enabled security protocols for this migration, including SSL on both the source and target sides.
Data MigrationDevopsAwsPostgresqlServerlessSsl
Solutions Architect
Jan 2019 – Dec 2019
Led a 6-member team to a higher level of maturity by improving processes and ensuring adherence to the Scrum framework and code review standards. Proposed multiple approaches for building a new AWS-based test automation framework. Introduced AWS QuickSight for test reporting, which also supported a more decoupled architecture. Integrated Apache Airflow (AWS MWAA) to automate test cases in test environments, supported by validation reports. Built complex validation queries in Aurora PostgreSQL to extract useful information stored in nested JSON format.
Test AutomationJsonPostgresqlScrumAwsApacheAirflowCode Review

Lost connection

The internet blinked. We’re catching up.

Reload page
An error has occurred. This application may no longer respond until reloaded.Reload 🗙