Role: Lead PySpark Engineer
Job type: Fulltime
Location: Owings Mill, MD
Roles & Responsibilities:
10+ years of experience in big data and distributed computing.
• Very Strong hands-on experience with PySpark, Python, Airflow, DBT & DWH concepts
• Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).
• Proficiency in data modeling and ETL workflows.
• Proficiency with workflow schedulers like Airflow
• Hands on experience with AWS cloud-based data platforms.
• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.
• Strong problem-solving skills and ability to lead a team
Develop, test and maintain high-quality solutions using PySpark /Python programming language.
· Participate in the entire software development lifecycle, building, testing and delivering high-quality
data pipelines.
· Collaborate with cross-functional teams to identify and solve complex problems.
· Write clean and reusable code that can be easily maintained and scaled.
· Keep up to date with emerging trends and technologies in Python development. Design and develop
business controls using AWS Glue and PySpark
· Integrate data from various sources into Amazon Redshift
· Optimize performance of data processing jobs and fine tune queries
Salary Range: $110,000 - $115,000 a Year
...Overview: Seeking an Advanced Practice Nurse-for the Inpatient Programs and the... ...specialist) Qualifications: Required: Graduate of an accredited School of Nursing with a... ...with prescriptive authority in the State of New Jersey Certified as an Advanced...
...ll be responsible for managing and coordinating vessel surveys, cargo inspections, personnel scheduling, and compliance activities at... ...and continuous improvement Handle documentation, shipping of samples, and records management Requirements: U.S. citizenship...
**Class A CDL Lease Purchase - 18-Month Truck Ownership ** No Credit Check!Position Details Take control with a truly Exceptional Lease Purchase plan - flexible,... ...weekly net (after deductions)Every other weekend0 down, no credit check, walk-away leaseOwn your truck...
...space since 2014. We work with the highest-end clientele and venues in Nashville, and we require the highest-end service from our team. Box Truck Drivers are responsible for driving safely to event venues, interacting with clients in a professional manner, and setting up...
...or aged inventory Assist store manager with maintaining the repair queue and making sure that repairs are being done on time and on... ...uBreakiFix: About Us:Since its inception in 2011 iDoctor Cell Phone and Tablet Repair LLC has sought to be an industry leader in...