Design and develop scalable data pipelines and ETL (Extract, Transform, Load) processes to collect, process, and integrate data from various sources into a centralized data warehouse or data lake.
Implementing data models, schemas, and database structures to organize and optimize data storage for efficient data retrieval, writing and analysis.
Collaborating with quantitative and analysts to understand their data requirements and provide them with the necessary infrastructure and tools for data exploration, analysis, and visualization.
Ensuring data quality and consistency by implementing data validation, cleaning, and transformation procedures.
Monitoring and maintaining the performance, availability, and security of data systems, including database servers, data warehouses, and data processing frameworks.
Troubleshooting and resolving data-related issues and performance bottlenecks in collaboration...