Our Client is seeking a Lead Data Engineer with SQL, Python and Capital banking to join our team in New York City, NY (Need Onsite day 1, hybrid 3 days from office).
Our challenge
Lead the development and optimization of batch and real-time data pipelines, ensuring scalability, reliability, and performance. Architect, design, and deploy data integration,
streaming, and analytics solutions leveraging Spark, Kafka, and Snowflake. Ability to help voluntarily and proactively, and support Team Members, Peers to deliver their tasks to ensure End-to-end delivery. Evaluates technical performance challenges and recommend
tuning solutions. Hands-on knowledge of Data Service Engineer to design, develop, and maintain our Reference Data System utilizing modern data technologies including Kafka, Snowflake, and Python.
Responsibilities:
Lead the development and optimization of batch and real-time data pipelines, ensuring scalability, reliability, and performance.
Architect, design, and deploy data integration, streaming, and analytics solutions leveraging Spark, Kafka, and Snowflake.
Ability to help voluntarily and proactively, and support Team Members, Peers to deliver their tasks to ensure End-to-end delivery.
Evaluates technical performance challenges and recommend tuning solutions.
Hands-on knowledge of Data Service Engineer to design, develop, and maintain our Reference Data System utilizing modern data technologies including Kafka, Snowflake, and Python.
Requirements:
Proven experience in building and maintaining data pipelines, especially using Kafka, Snowflake, and Python.
Strong expertise in distributed data processing and streaming architectures.
Experience with Snowflake data warehouse platform: data loading, performance tuning, and management.
Proficiency in Python scripting and programming for data manipulation and automation.
Familiarity with Kafka ecosystem (Confluent, Kafka Connect, Kafka Streams) is a big plus.
Knowledge of SQL, data modeling, and ETL/ELT processes.
Understanding of cloud platforms (AWS, Azure, GCP) is a plus
Domain Knowledge in any of the below area:
Trade Processing, Settlement, Reconciliation, and related back/middle-office functions within financial markets (Equities, Fixed Income, Derivatives, FX, etc.).
Strong understanding of trade lifecycle events, order types, allocation rules, and settlement processes.
Funding Support, Planning & Analysis, Regulatory reporting & Compliance. Knowledge of regulatory standards (such as Dodd-Frank, EMIR, MiFID II) related to trade reporting and lifecycle management
cFocus Software seeks a Cyber Security Engineer to join our program supporting the Department of Defense (DoD). This position is remote. This position requires the ability a Public Trust clearance. Qualifications: Bachelors degree in Cybersecurity, Information Assurance...
...care team who work to ensure that the facility is maintained in a clean, safe, and comfortable manner and to ensure that an adequate... ...Insurance: Critical Illness Accident Disability Coverage Hospital Indemnity ~ Life Insurance through Cincinnati Life:...
...Full/Part-Time Dental Lab Courier / Driver Are you an experienced driver with a knack for organization? Reliable Dental Lab is seeking... ...Exhibit strong attention to detail and organizational skills. Independence: Self-starter with the ability to work independently and...
...The University of Iowa Health Care department of Safety and Security is seeking a Hospital Security Officer to perform duties needed to maintain a safe and secure environment for patients, visitors, and staff in the buildings and grounds of the University of Iowa...
...We are currently hiring a FT Creative Designer to be hybrid at our Boston, MA office . Our Creative Designer is responsible for... ...individual performance, and certain sales roles might include a car allowance. Some Perks: Our people are our most important ...