Role - Data Engineer / Support Analyst - Databricks
Location: New York, NY / Hamilton Township, NJ / Bellevue, WA - onsite
Contract
Job Description
We are seeking an experienced Data Engineer / Support Analyst with strong expertise in Databricks, Azure cloud services and batch job support. The ideal candidate will have a background in financial markets or trading systems, with hands‑on experience managing data pipelines, FTP file transfers, and real‑time/batch processing in a production environment.
Key Responsibilities
* Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory.
* Integrate and process Bloomberg market data feeds and files into trading or analytics platforms.
* Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion.
* Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.
* Manage FTP/SFTP file transfers between internal systems and external vendors.
* Ensure data quality, completeness, and timeliness for downstream trading and reporting systems.
* Collaborate with operations, application support, and infrastructure teams to resolve incidents and enhance data workflows.
Required Skills & Experience
* 10+ years of experience in data engineering or production support within financial services or trading environments.
* Hands‑on experience with Azure Databricks, Azure Data Factory, and Azure Storage, Logic Apps, Fabric.
* Strong Python and SQL programming skills.
* Experience with Bloomberg data feeds (BPIPE, TSIP, SFTP).
* Experience with Git, CI/CD pipelines, and Azure DevOps.
* Proven ability to support batch jobs, troubleshoot failures, and manage job scheduling.
* Experience handling FTP/SFTP file transfers and automation (e.g., using scripts or managed file transfer tools).
* Solid understanding of equities trading, fixed income trading, trading workflows, and financial instruments.
* Excellent communication, problem‑solving, and stakeholder management skills.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
#J-18808-Ljbffr