Data Engineer

Company: Wal-Mart
Location: San Francisco
Posted on: April 1, 2025

Job Description:

FocusKPI is looking for a Data Engineer to join our internal team and help one of our clients with their projects.We are seeking a Data Engineer to design and implement data pipelines linking SAP, Databricks, and Microsoft CRM while automating data flow for analytics and forecasting.Work Location: Remote - anywhere in the USDuration: 9+ months contractPay Range: $60/hr to $85/hr (on basis of experience level)Responsibilities:

• Develop ETL pipelines to extract SAP data and load it into Databricks and Microsoft CRM, ensuring accurate and structured data transfer.
• Automate data ingestion and transformation processes using Python, SQL, and cloud-based tools to reduce manual intervention and improve efficiency.
• Extract and process transactional, master, and historical data from SAP, including SAP HANA, SAP BW, or OData, and ensure it is properly formatted for downstream analytics.
• Monitor and troubleshoot pipeline failures, ensuring minimal downtime and maintaining data reliability for analytical use cases.
• Collaborate with data scientists and analysts to make data accessible for AI-driven forecasting models.
• Maintain access control and security configurations to ensure sensitive business data is handled in compliance with internal policies.Qualifications:
  • 2-5 years of experience in data engineering, specializing in ETL development and enterprise data integration.
  • Proficiency in Python and SQL for data transformation, pipeline automation, and query optimization.
  • Strong understanding of data schema design, indexing, and performance tuning for large datasets.
  • Experience with workflow orchestration tools (e.g., Apache Airflow, Prefect, or Azure Data Factory) to schedule and automate data tasks.
  • Familiarity with machine learning model deployment for forecasting and predictive analytics.
  • Experience with CI/CD pipelines for data engineering, including version control, testing, and deployment.
  • Experience with Databricks, including Delta Lake storage, query optimization, and structured data management.
  • Familiarity with Microsoft CRM (Dynamics preferred) and the data models used for customer and business analytics.
  • Experience implementing data governance frameworks, including data security, access controls, and logging.**No C2C profiles are accepted**Thank you!FocusKPI Hiring Team
    #J-18808-Ljbffr

Keywords: Wal-Mart, San Francisco , Data Engineer, Engineering , San Francisco, California