Work Experience

Data Engineer - USA

In my role as a Data Engineer at Johnson & Johnson, I spearheaded critical tasks in projects involving data migration to Azure cloud. I conducted thorough data analysis to understand existing structures and devised optimal solutions for seamless migration. Leveraging Azure Data Factory (ADF), I developed and implemented robust ETL pipelines to efficiently transfer data from Oracle DB and SQL Server to Azure SQL Server. Additionally, I took charge of managing cloud databases, ensuring data integrity throughout migration and ongoing operations. Utilizing tools like Power BI, I created insightful dashboards and reports to visualize key metrics, particularly sales trends, aiding in informed decision-making. Proactively monitoring data pipelines and swiftly addressing any issues were vital aspects of ensuring smooth operations and data reliability. My role emphasized leveraging cloud technologies and ETL processes to drive actionable insights and enhance overall business operations.

Roles and Responsibilities

    Data Analysis and Solution Design:

  • Conducted in-depth analysis of existing Oracle DB data structures and business requirements.
  • Designed comprehensive data migration strategies tailored to Azure cloud (Kenvue) environment.

    • ETL Pipeline Development:

  • Developed complex Azure Data Factory (ADF) pipelines for efficient data extraction, transformation, and loading.
  • Utilized Azure Databricks for advanced data processing and transformation tasks.

    • Cloud Database Management:

  • Migrated data from SQL Server to Azure SQL Database using Azure Database Migration Service (DMS).
  • Implemented schema changes and optimizations to enhance data performance in the cloud environment.
  • Transferred data warehouse from Azure Synapse Analytics to Snowflake for scalability and performance gains.

    • Dashboard Creation and Reporting:

  • Built interactive dashboards and reports using Power BI for real-time data visualization and analysis.
  • Integrated Azure Analysis Services to provide OLAP capabilities for complex reporting requirements.

    • Monitoring and Maintenance:

  • Implemented Azure Monitor and Azure Log Analytics for proactive monitoring of data pipelines and system health.
  • Set up alerts and notifications to promptly address any issues or failures in data processing.

    • Training and User Support:

  • Conducted workshops and training sessions to empower users in leveraging business intelligence tools effectively.
  • Provided ongoing technical support to end-users for dashboard navigation and data interpretation.

Data Engineer USA

In my role as a Data Engineer & Analytics professional at META, I led critical initiatives to enhance data pipelines and reporting processes. One notable project involved rebuilding the SBG (Small Business Group) pipeline, where I optimized code readability and execution time. By migrating legacy pipelines and updating logic to optimize code, I achieved significant improvements, reducing execution time from 7 hours to 4.5 hours. Additionally, I focused on streamlining data integration workflows and resolving data issues within SBG Weekly reports and Data Playground Dashboards using tools like Hadoop, Hive, and Apache Spark. These enhancements resulted in a 20% increase in data processing speed and optimized memory usage, significantly enhancing dashboard performance and user experience. Throughout these projects, I also provided on-call support, monitoring pipeline failures through DAG (Directed Acyclic Graph) setups, and addressed production issues promptly to ensure data continuity and reliability.

Professional Summary

    Data Pipeline Optimization and Monitoring:

  • Rebuilt and optimized the Small Business Group (SBG) data pipeline using Hadoop ecosystem technologies such as Apache Hive and Apache Spark.
  • Implemented a Directed Acyclic Graph (DAG) to monitor pipeline workflows, track dependencies, and automate data processing tasks.

    • Pipeline Migration and Performance Enhancement:

  • Led the migration of legacy pipelines using T-SQL (Transact-SQL) for database operations and optimization.
  • Achieved a significant reduction in execution time from 7 hours to 4.5 hours, leveraging Apache Spark for distributed data processing.

    • Code Refactoring and Optimization:

  • Achieved a 30% reduction in code volume by refactoring and eliminating redundancies, leveraging T-SQL and Python scripting.
  • Applied best practices to optimize code performance and resource utilization within the SBG data pipeline.

    • Dashboard and Reporting Enhancements:

  • Streamlined data integration workflows and resolved data issues impacting SBG Weekly reports and Data Playground Dashboards, utilizing Apache Hive and Tableau.
  • Increased data processing speed by 20% and optimized memory usage to enhance dashboard performance and user experience.

    • Production Support and Infrastructure Maintenance:

  • Provided critical on-call support to monitor pipeline execution and address production issues promptly.
  • Collaborated with the team on infrastructure maintenance and performed routine system checks to ensure pipeline reliability.

Systems Engineer

During my tenure at TCS, I played a pivotal role in the E-commerce industry, leading a team of 8 professionals and reporting directly to the Vice President. I spearheaded the design and development of interactive dashboards and reports using Tableau, resulting in a 30% increase in data accessibility and decision-making efficiency. Leveraging sales data analysis, I identified trends and insights that led to a 15% improvement in sales performance and collaborated with sales leaders to implement recommended business actions, contributing to a 20% increase in revenue. I maintained structured databases, executed CRUD operations, and provided critical business intelligence (BI) support. Additionally, I facilitated stakeholder engagement, conducted performance evaluations, and implemented process enhancements to optimize team efficiency and project delivery.

Professional Summary

    Data Dashboard Development and Optimization:

  • Designed and developed interactive dashboards and reports in Tableau, improving data accessibility and decision-making efficiency by 30%.
  • Utilized data analysis to identify sales trends and insights, contributing to a 15% improvement in overall sales performance.

    • Database Management and Operations:

  • Implemented CRUD (Create, Read, Update, Delete) operations to maintain structured databases, ensuring data integrity and accessibility.
  • Supported database maintenance activities, including performance tuning, backups, and data security measures.

    • Documentation and BI Solution Development:

  • Developed comprehensive documentation of BI solutions, including ETL processes and visualizations, to facilitate knowledge sharing and collaboration.
  • Defined and executed BI strategies to optimize data processing and reporting capabilities, enhancing business intelligence initiatives.

    • Stakeholder Engagement and Relationship Management:

  • Engaged with stakeholders at all levels, including senior management, to understand business requirements and deliver tailored BI solutions.
  • Cultivated strong relationships with key stakeholders, earning trust and credibility through effective communication and data-driven decision support.

    • Strategic Reporting to Vice President (VP):

  • Reported project progress and outcomes to the Vice President, providing strategic insights and recommendations based on data analysis.
  • Collaborated with the VP to align project goals with overall business objectives, driving initiatives to improve sales performance and operational efficiency.

    • Team Leadership and Collaboration:

  • Led a team of 8 professionals in the E-commerce industry, providing guidance and oversight to ensure project success.
  • Fostered a collaborative team environment, promoting knowledge sharing and professional development among team members.

Email

eshravankumar9@gmail.com

Address

Irving, TX 75063
United States of America