Our Client is seeking a Lead Data Engineer with SQL, Python and Capital banking to join our team in New York City, NY (Need Onsite day 1, hybrid 3 days from office).
Our challenge
Lead the development and optimization of batch and real-time data pipelines, ensuring scalability, reliability, and performance. Architect, design, and deploy data integration,
streaming, and analytics solutions leveraging Spark, Kafka, and Snowflake. Ability to help voluntarily and proactively, and support Team Members, Peers to deliver their tasks to ensure End-to-end delivery. Evaluates technical performance challenges and recommend
tuning solutions. Hands-on knowledge of Data Service Engineer to design, develop, and maintain our Reference Data System utilizing modern data technologies including Kafka, Snowflake, and Python.
Responsibilities:
Lead the development and optimization of batch and real-time data pipelines, ensuring scalability, reliability, and performance.
Architect, design, and deploy data integration, streaming, and analytics solutions leveraging Spark, Kafka, and Snowflake.
Ability to help voluntarily and proactively, and support Team Members, Peers to deliver their tasks to ensure End-to-end delivery.
Evaluates technical performance challenges and recommend tuning solutions.
Hands-on knowledge of Data Service Engineer to design, develop, and maintain our Reference Data System utilizing modern data technologies including Kafka, Snowflake, and Python.
Requirements:
Proven experience in building and maintaining data pipelines, especially using Kafka, Snowflake, and Python.
Strong expertise in distributed data processing and streaming architectures.
Experience with Snowflake data warehouse platform: data loading, performance tuning, and management.
Proficiency in Python scripting and programming for data manipulation and automation.
Familiarity with Kafka ecosystem (Confluent, Kafka Connect, Kafka Streams) is a big plus.
Knowledge of SQL, data modeling, and ETL/ELT processes.
Understanding of cloud platforms (AWS, Azure, GCP) is a plus
Domain Knowledge in any of the below area:
Trade Processing, Settlement, Reconciliation, and related back/middle-office functions within financial markets (Equities, Fixed Income, Derivatives, FX, etc.).
Strong understanding of trade lifecycle events, order types, allocation rules, and settlement processes.
Funding Support, Planning & Analysis, Regulatory reporting & Compliance. Knowledge of regulatory standards (such as Dodd-Frank, EMIR, MiFID II) related to trade reporting and lifecycle management
...Summary The Assistant Property Manager plays an integral role in the success of our team, our community and creating a place our residents... ...with excellent time management skills Education and Experience High School Diploma or GED Equivalent One year of hospitality...
...Adults, Pediatrics Patient Volume: 18 Support Staff: 1 RN, 2 MAs Procedures: Chronic Pain Management EMR: EPIC Travel, lodging, and malpractice insurance covered Requirements: Active CA license BC/BE BLS DEA COVID Vaccine (Primary...
...customer service and offering the latest innovations in the automotive industry. As a well established dealership in Williamsburg, VA... ...Description: Mills Auto Group is seeking an experienced and motivated Sales Manager to lead our sales team at our dealership in Williamsburg, VA....
SWIFT DEDICATED REFRIGERATED OPPORTUNITYOut of Opelika, AL$3000 Sign on BonusHOME DAILY!NO TOUCH FREIGHTAdvantages of Swift Dedicated Refrigerated Fleet~Great Pay!~HOME DAILY!~Consistent Miles!Swift Refrigerated is going back to the program that ...
...without sponsorship, and C2C arrangements are not accepted. This role is hybrid. Job Summary The Network & Cyber Engineer is responsible for maintaining a secure, reliable, and high-performance network infrastructure while also supporting core cybersecurity...