ETL Jobs

I run a prediction system, an ERP system, a standalone CRM, several database servers, and a CONTROL SYSTEM / MES on our production floor. Right now each platform lives in its own silo and I constantly need to move files or run manual exports. The immediate goal is true data synchronization—when a customer record updates in the CRM it should appear in the ERP, when production status changes in the MES it should be logged back to the central database, and so on. If this also streamlines processes and improves analytics, that is a welcome bonus, but real-time, bidirectional data consistency comes first. Here is what I need from you: • Assess the current architecture and identify the safest connection points (APIs, message queues, ETL jobs, middleware, etc.). • Build and co...

Looking for an Experienced Data Engineer Project Description I am looking for a skilled Data Engineer to help design, build, and maintain reliable data pipelines and infrastructure. The work may include collecting data from different sources, cleaning and transforming it, and storing it in a database or data warehouse. You may also work with APIs, cloud services, ETL workflows, and large datasets. The ideal candidate should have strong experience with Python, SQL, data modeling, and ETL/ELT pipelines. Experience with AWS, GCP, or Azure is preferred. Knowledge of tools such as Airflow, Spark, Kafka, Snowflake, BigQuery, or Databricks would be a plus. Please include the following in your proposal: A short introduction about your Data Engineering experience Examples of similar projects ...

Senior Data Engineer Needed for Cloud Data Pipelines and Data Warehouse We are looking for an experienced Senior Data Engineer to help design, build, improve, and maintain our data platform. The selected freelancer will work with our team to develop reliable data pipelines, integrate multiple data sources, improve data quality, and prepare analytics-ready datasets. Responsibilities: • Design and develop scalable ETL and ELT pipelines • Integrate data from APIs, databases, files, and third-party platforms • Build and optimize data warehouse models • Write efficient Python and SQL code • Configure workflow orchestration, monitoring, logging, and error handling • Troubleshoot pipeline failures and performance issues • Implement data-quality checks and va...

Azure Data Factory + Azure SQL Expert Needed to Debug and Implement Data Processing Change Description I'm looking for an experienced Azure Data Engineer with strong knowledge of Azure Data Factory, Azure SQL, SQL Stored Procedures, and Databricks to help implement a change in an existing production data pipeline. Environment Azure Data Factory Azure SQL Database Mapping Data Flows Azure Data Lake Storage (ADLS) Databricks SQL Stored Procedures Current Situation I have already completed the initial analysis: Identified the source table. Traced the ADF pipeline. Reviewed the Mapping Data Flow. Identified the destination Azure SQL table. Identified SQL views and stored procedures referencing the table. Reviewed one of the stored procedures. The remaining work is to: Trace the com...

I’m building a new web-based platform whose core value is clear, interactive data-visualization. To get there I need an experienced Nigerian software engineer who is equally at home designing back-end services and shaping the data that feeds them. Your first mandate will be to architect and code the full data pipeline—from ingestion through transformation to storage—so that the front-end team always has clean, query-ready information. You’ll also dive into exploratory and diagnostic analysis, helping us uncover trends that inform product decisions and power the visual stories we show users. The stack is flexible, but you should be comfortable with modern data-engineering tools (think Python or Scala for ETL, SQL-based warehouses, stream processing frameworks, ...