Posted: 10/03/20222022-10-032022-11-04Employment Type:Direct Hire/PermJob Category:Data SciencesJob Number: 509879Is job remote?: YesCountry: United States
Job Description
Lead Technical Data Engineer
Must have candidate answer these questions and answers come in with submittal.
What, according to you, are the daily responsibilities of a data engineer?
What is structured vs. unstructured data?
How can you deploy a big data solution?
You made a decision on how to do something and it doesn't seem to be going well. No one likes it and the results have impacted the team. What do you do?
Lead Data Engineer
80% of the time fully hands on
building data pipelines
maintaining ETLs - build and support ETL processes
20% management/lead engineer
Management position - 3-4 ppl reporting to this person
Help, direct and bring team up to speed on certain technologies
Design
Code review
Best practices
Staying up-to-date on the latest industry technologies
Design Principles and approaches to delivering data products
Soft skills important: creative approach, give opinion and meetings, be able to defend why this technology is to be used, why this tool is the best tool to be used for the project etc.
ETL processes in SSIS - creating new process, and maintaining existing ones
Main technologies and skills
SQL and NoSQL databases, they are MS shop
On the AWS side S3, Glue, Red Shift, Dynamo DB, or something similar
Familiarity with different data formats
Knowledge of Data Lake in general required
Data Warehouse principals
Glue is nice to have
Python is required
Converting operational data into analytical data
Handling data migrations/integrations they use SSIS
Graph Data, Neo, 4J, Arango DB nice to have
AWS delta functions (python REQUIRED)
Skills:
Familiarity with different data formats
Will be creating new data processes and being familiar with existing ones
Building data pipelines is the main thing you will be doing
Customer relationship management
Data Storage
Ability to query data from no SQL databases
When you work with a data lake, you need to store your data in a certain format...understanding different formats - knowing differences
Data warehouse principals and concepts
Work with machine learning engineer and data analyst
Three most important things a candidate must have:
Python
Data Lakes
No SQL Databases
The staffing industry has seen an increase in people falsely representing themselves as recruiters to gather personal information from job seekers. For your safety, do not provide sensitive data to anyone you have not spoken with thoroughly, never provide banking information during the application process and always double check the email address of the recruiter to ensure it’s from @planet-technology.com - and not a domain with an alternative extension like .net, .org or .jobs. Candidate safety is a top priority at Planet Technology.
Planet Technology and The Planet Group of Companies are equal opportunity employers. It is our practice not to discriminate against any employee or applicant based on any criteria, condition or basis protected by laws or regulations in the locations where we do business. All qualified applicants are encouraged to apply. We celebrate diversity and are committed to providing an environment of mutual respect. We believe that diversity, equity and inclusion enable us to better meet our mission and values while serving our clients across the globe. If you have a disability or handicap and would like us to accommodate you in any reasonable way, please inform your recruiter, or contact us, so that we can discuss the appropriate alternatives available.
There are currently no related jobs. Please sign up for Job Alerts.
Loading...
Login to save this search and get notified of similar positions.
About Alexandria, VA
Discover your next career opportunity in the thriving area around Alexandria, Virginia! Nestled on the banks of the Potomac River, this charming location offers job seekers a unique blend of history, culture, and growth. From exploring the rich historic sites like Mount Vernon to indulging in delicious seafood at local eateries along King Street, Alexandria has something for everyone. Immerse yourself in the vibrant arts scene with visits to the Torpedo Factory Art Center or catch a show at the renowned Birchmere Music Hall. With easy access to Washington D.C., top-notch schools, and a range of outdoor activities in parks like Huntley Meadows, consider Alexandria for your next career move. Begin your job search today and unlock exciting opportunities in this dynamic region!
Are you sure you want to apply for this job?
Please take a moment to verify your personal information and resume are up-to-date before you apply.