Position: Lead Data Engineer
Location: Hybrid onsite in McLean, VA, Richmond, VA, or Plano, TX
Duration: 12+ Months
Position Description:
Our leading Fortune 100 Financial Services client is looking to bring on a Lead Data Engineer to assist with several business critical pushes. In this role you will be contributing a specific line of business of our clients and developing new best practices in data movement and transformation.
Responsibilities:
- Partner with product owners, peers, and end-users to understand business requirements and identify risk/issues in a timely matter and escalate as necessary.
- Be the intersection with lines of business, Finance and Technology. The ability to understand various perspectives is critical when optimizing an engineering solution.
- Provide technical guidance concerning business implications of application development projects
- Leverage programming skills in open source languages including Python and SQL on various frameworks especially Spark.
- Manage multiple responsibilities in an unstructured environment where you're empowered to make a difference. In that context, you will be expected to research and develop cutting edge technologies to accomplish your goals.
Required Skills:
- 8 – 10+ years of related experience.
- Solid understanding and experience in big data solutions using open-source languages such as Python and SQL on Spark framework.
- Experience working on data projects and data management involving querying databases and/or transforming legacy data platforms to future data streaming platforms.
- Solid understanding and experience in Cloud computing, preferably AWS and its services including Glue, EMR/EC2, DynamoDB and Lambda functions.
- Test Automation.
Desired Skills (not required but candidate will have exposure to these skills in this role):
- Experience working in Financial Services industry
Required Skills : lead, 12+ yrs experience, computer science degree, python + pandas, aws, emr, sns/sqs, flask