Back to search

Data Engineer

The primary role of the Data Engineer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company’s objectives.

  • Charlotte, North Carolina, United States
  • Full-time
  • On-site
  • $45–$55 per hour
  • Posted Nov 10, 2026

Responsibilities

  • Design and develop data/batch processing solutions
  • Design and develop data manipulation, mining, and extraction/transformation/loading pipelines
  • Implement ETL processes using Python and Pyspark
  • Utilize AWS services such as Glue, Lambda, MSK, S3, Step Functions, RDS, EKS
  • Develop and maintain SQL databases including Postgres, SQL Server, Oracle, Sybase
  • Write and optimize SQL queries, stored procedures, views, functions, and triggers
  • Create and maintain data models, data mining, analysis, and profiling
  • Develop REST APIs
  • Automate workloads with Control-M and Autosys
  • Implement CI/CD pipelines using Bitbucket, GitHub, Jenkins
  • Apply Agile/SCRUM methodology
  • Use other ETL tools such as DataStage, Informatica, Pentaho
  • Manage MDM, data warehouse, and data analytics projects

Skills

PythonPysparkAWS GlueAWS LambdaAWS MSKAWS S3AWS Step FunctionsAWS RDSAWS EKSPostgresSQL ServerOracleSybaseSQLUNIX scriptsOracle SQL/PL-SQLREST APIsControl-MAutosysBitbucketGitHubJenkinsAgileSCRUMDataStageInformaticaPentahoMDMData warehouseData analyticsPythonPysparkAWS GlueAWS LambdaAWS MSKAWS S3AWS Step FunctionsAWS RDSAWS EKSPostgresSQL ServerOracleSybaseSQLUNIX scriptsOracle SQL/PL-SQLREST APIsControl-MAutosysBitbucketGitHubJenkinsAgileSCRUMDataStageInformaticaPentahoMDMData warehouseData analytics

Benefits

  • Four options of medical insurance
  • Dental and Vision Insurance
  • 401k Contributions
  • Critical Illness Insurance
  • Voluntary Permanent Life Insurance
  • Accident Insurance
  • Other Employee Perks

More jobs nearby

Full description

Job Title: Data Engineer Job Description: The primary role of the Data Engineer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company’s objectives. They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/Pyspark and AWS tools. Skills and Knowledge: Developer experience specifically focusing on Data Engineering. Hands-on experience in Development using Python and Pyspark as an ETL tool. Experience in AWS services like Glue, Lambda, MSK (Kafka), S3, Step functions, RDS, EKS etc. Experience in Databases like Postgres, SQL Server, Oracle, Sybase etc. Experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions, and triggers. Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing). Knowledge in developing UNIX scripts, Oracle SQL/PL-SQL. Experience with data models, data mining, data analysis and data profiling. Experience in working with REST API's. Experience in workload automation tools like Control-M, Autosys etc. Good knowledge in CI/CD DevOps process and tools like Bitbucket, GitHub, Jenkins. Strong experience with Agile/SCRUM methodology. Experience with other ETL tools (DataStage, Informatica, Pentaho, etc.). Knowledge in MDM, Data warehouse and Data Analytics. Location: Charlotte, NC 28203 (Onsite) Compensation: $45.00 - $55.00 per hour on W2 Benefits: At LanceSoft, full time regular employees who work a minimum of 30 hours a week or more are entitled to the following benefits: • Four options of medical Insurance • Dental and Vision Insurance • 401k Contributions • Critical Illness Insurance • Voluntary Permanent Life Insurance • Accident Insurance • Other Employee Perks About LanceSoft LanceSoft is rated as one of the largest staffing firms in the US by SIA. Our mission is to establish global cross-culture human connections that further the careers of our employees and strengthen the businesses of our clients. We are driven to use the power of our global network to connect businesses with the right people, and people with the right businesses without bias. We provide Global Workforce Solutions with a human touch Equal Opportunity Statement: LanceSoft is a certified Minority Business Enterprise (MBE) and an equal opportunity employer. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws. This policy applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. LanceSoft makes hiring decisions based solely on qualifications, merit, and business needs at the time.

Data Engineer at LanceSoft Inc | Referso Jobs