Data Engineer Lead Job at Purple Fly Solutions, Dallas, TX

Y3ZOKytIYWpmSHhrczZsWi9nM0xPRGluSFE9PQ==
  • Purple Fly Solutions
  • Dallas, TX

Job Description

- Role: Data Engineer Lead
- Location: Dallas, TX
- Full-time position
- Senior candidate with a minimum of 10 years of experience
- Experience in Node JS is required
- Should have worked as a lead in at least one project
- Advanced SQL knowledge and experience with relational databases
- Experience with building and optimizing big data pipelines, architectures, and data sets
- Familiarity with AWS cloud services such as EMR, EC2, EKS
- Experience performing root cause analysis on data and processes
- Strong analytical skills for working with unstructured datasets
- Ability to build processes supporting data transformation, data structures, metadata management, etc.
- Experience with manipulating, processing, and extracting value from large disconnected datasets
- Working knowledge of message queuing, stream processing, and big data data stores
- Strong project management and organizational skills
- Experience working with cross-functional teams in a dynamic environment
- Proficiency with AWS cloud services: EC2, EMR, EKS, Snowflake, Elastic-Search
- Experience with stream-processing systems: Storm, Spark-Streaming, Kafka
- Experience with scripting languages: Python, Java, C++, Scala
- Knowledge of relational SQL and NoSQL databases, including Postgres and Cassandra
- Experience with DevOps, data pipeline, and workflow management tools: Concourse, Terraform, Luigi, Airflow
- Bachelor's degree in computer science or a related field with at least 10 years of relevant experience.

Job Tags

Full time,

Similar Jobs

Classet

Craftsman/Carpenter Job at Classet

 ...We're open to hiring both full time W2 Employees as well as subcontractors - whichever you prefer! We have tons of work to keep you busy...  ...good overall knowledge of all tradesfrom Carpentry, Tiling, Painting, and Drywalling to light Plumbing and Electrical. Specific... 

Sage IT Inc

ELK Elastic Support Job at Sage IT Inc

 ...ELK Elastic Support Consultant Location: Mclean VA or Plano TX (Onsite) Job Description: Design and implement ELK (Elastic Search Logstash and Kibana) solutions. Handon Experience in creating and managing indexs in Elasticsearch based on requirements... 

The Faulkner Automotive Group

Sales Consultant Intern Job at The Faulkner Automotive Group

 ...Operations Benefits, include: - Experience shadowing internet sales, sales, and finance in a dealership setting - Take part in assisting...  .... They will start in internet sales and help manage the online sales conducted through a dealerships website. They will assist... 

Flooring Careers

Marketing /Social Media Manager Job at Flooring Careers

 ...Generate, edit, publish and share engaging content daily (e.g. original text, photos, videos, eblasts and press releases) Monitor SEO (Search Engine Optimization) and web traffic metrics Collaborate with department/division teams to ensure brand consistency Communicate... 

Tools & Accessories Corp

Delivery Driver-(Non-CDL) Job at Tools & Accessories Corp

 ...or billing statements, in accordance with regulations. Read maps and follow written or verbal geographic directions. Report delays...  ...of prior commercial driving experience and deliveries. Valid Driver's License. Motor Vehicle Record must show a record of sustained...