Search Jobs

Lead Technical Data Engineer

Alexandria, VA 22314

Posted: 10/03/2022 Employment Type: Direct Hire/Perm Job Category: Data Sciences Job Number: 509879 Is job remote?: Yes Country: United States

Job Description


Lead Technical Data Engineer

 

Must have candidate answer these questions and answers come in with submittal.
  1. What, according to you, are the daily responsibilities of a data engineer? 
  2. What is structured vs. unstructured data?
  3. How can you deploy a big data solution?
  4. You made a decision on how to do something and it doesn't seem to be going well. No one likes it and the results have impacted the team. What do you do?

 

 

Lead Data Engineer

80% of the time fully hands on
  • building data pipelines
  • maintaining ETLs - build and support ETL processes

 

20% management/lead engineer
  • Management position - 3-4 ppl reporting to this person
  • Help, direct and bring team up to speed on certain technologies
  • Design
  • Code review
  • Best practices
  • Staying up-to-date on the latest industry technologies
  • Design Principles and approaches to delivering data products
  • Soft skills important: creative approach, give opinion and meetings, be able to defend why this technology is to be used, why this tool is the best tool to be used for the project etc.
  • ETL processes in SSIS - creating new process, and maintaining existing ones

 

 

Main technologies and skills
  • SQL and NoSQL databases, they are MS shop
  • On the AWS side S3, Glue, Red Shift, Dynamo DB, or something similar
  • Familiarity with different data formats
  • Knowledge of Data Lake in general required
  • Data Warehouse principals
  • Glue is nice to have
  • Python is required
  • Converting operational data into analytical data
  • Handling data migrations/integrations they use SSIS
  • Graph Data, Neo, 4J, Arango DB nice to have
  • AWS delta functions (python REQUIRED)

 

Skills:
  • Familiarity with different data formats
  • Will be creating new data processes and being familiar with existing ones
  • Building data pipelines is the main thing you will be doing
  • Customer relationship management
  • Data Storage
  • Ability to query data from no SQL databases
  • When you work with a data lake, you need to store your data in a certain format...understanding different formats - knowing differences
  • Data warehouse principals and concepts
  • Work with machine learning engineer and data analyst

 

Three most important things a candidate must have:
  • Python
  • Data Lakes
  • No SQL Databases
Apply Online

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.

About Alexandria, VA

Discover your next career opportunity in the thriving area around Alexandria, Virginia! Nestled on the banks of the Potomac River, this charming location offers job seekers a unique blend of history, culture, and growth. From exploring the rich historic sites like Mount Vernon to indulging in delicious seafood at local eateries along King Street, Alexandria has something for everyone. Immerse yourself in the vibrant arts scene with visits to the Torpedo Factory Art Center or catch a show at the renowned Birchmere Music Hall. With easy access to Washington D.C., top-notch schools, and a range of outdoor activities in parks like Huntley Meadows, consider Alexandria for your next career move. Begin your job search today and unlock exciting opportunities in this dynamic region!