Vertica Developer / Data Engineer

На данный момент Senior Software Engineer.

Мои компетенции и опыт

Ethan Lim

Singapore | нужен доступ к резюме | нужен доступ к резюме | нужен доступ к резюме

Summary

With 10 years of experience in software engineering, I specialize in building ETL pipelines, designing data marts, and developing high-performance backend solutions using нужен доступ к резюме and TypeScript. I have extensive experience with SQL databases, complex queries, and data transformation workflows for analytics and business intelligence. I am skilled in DWH design, event-driven architectures, and cloud-based deployment with CI/CD automation. My expertise spans the full data lifecycle, from requirements gathering and design to testing, deployment, and operational support. I excel at delivering efficient, maintainable, and scalable data solutions.

Experience

Rescode | Senior Software Engineer May 2022 ~ Present

• Developed ETL pipelines in нужен доступ к резюме processing 5TB of daily analytics data.
• Optimized SQL queries in PostgreSQL and Vertica, reducing transformation latency to 300ms.
• Designed data marts supporting 50 business KPIs and dashboards for analysts.
• Built event-driven collectors with TypeScript handling 200k events/hour.
• Automated deployments and CI/CD pipelines with GitLab and Jenkins, reducing release time by 60 minutes.
• Implemented Redis caching to improve query performance across pipelines.
• Conducted code reviews and enforced design patterns for maintainability.
• Mentored 4 junior developers on ETL best practices and нужен доступ к резюме development.
• Built RESTful APIs for analytics ingestion and reporting.
• Wrote unit and integration tests using Mocha, achieving stable production deployments.
• Documented ETL processes, data flow, and system architecture.
• Monitored pipeline health with Prometheus and Grafana dashboards.
• Integrated Kafka-based messaging for real-time data ingestion.
• Tuned Vertica configurations for high-load query execution.
• Conducted root cause analysis for ETL job failures.
• Refactored legacy SQL scripts for improved performance.
• Standardized error handling and logging across services.
• Streamlined data lifecycle workflows to reduce operational overhead.

Doodle Labs | Senior Full Stack Engineer Apr 2019 ~ Apr 2022

• Developed backend data aggregators in нужен доступ к резюме and TypeScript for analytics applications.
• Designed and implemented ETL processes for SQL and NoSQL databases.
• Built Angular and нужен доступ к резюме dashboards for real-time data visualization.
• Optimized PostgreSQL queries using CTEs and window functions for analytics reporting.
• Implemented CI/CD pipelines using Jenkins and GitLab CI for automated releases.
• Integrated Redis caching for high-throughput data queries.
• Conducted unit testing with Mocha and Chai, improving deployment reliability.
• Collaborated with product and analytics teams to define requirements.
• Built REST APIs for internal and external data services.
• Managed Docker containers and Kubernetes deployments.
• Monitored system performance and executed optimization strategies.
• Refactored legacy ETL scripts for maintainability and scalability.
• Authored internal documentation for workflows and architecture.
• Mentored junior developers on нужен доступ к резюме , ETL, and database best practices.
• Standardized logging and monitoring across data pipelines.

Wise | Full Stack Engineer May 2015 ~ Feb 2019

• Developed нужен доступ к резюме ETL pipelines for processing transaction and user data.
• Wrote complex SQL queries with CTEs and window functions for reporting.
• Built data marts supporting financial dashboards and KPIs.
• Designed RESTful APIs for data ingestion and retrieval.
• Integrated Angular and ReactJS frontends with backend services.
• Implemented unit and integration testing for ETL jobs.
• Tuned database performance for high-volume queries.
• Automated CI/CD pipelines with Jenkins and Docker.
• Monitored system health and executed root cause analysis on failures.
• Mentored junior engineers in нужен доступ к резюме and data engineering practices.
• Streamlined ETL processes to reduce latency and resource consumption.
• Authored comprehensive documentation for ETL workflows and data schemas.
• Applied design patterns to backend services to ensure maintainability.

Education

National University of Singapore Aug 2009 ~ Jul 2013

Bachelor’s Degree in Computer Science

Skills

Programming Languages & Frameworks: нужен доступ к резюме , TypeScript, JavaScript, PHP, Laravel, Go, Python, OOP, Design Patterns, SOLID Principles
Frontend Engineering: Angular, нужен доступ к резюме , ReactJS, HTML5, CSS3, SPA Development
Backend / API Development: ETL Pipelines, RESTful APIs, Microservices, Data Aggregators, API Gateway, Event-Driven Architecture
DevOps / Infrastructure / CI/CD: Docker, Kubernetes, Jenkins, GitLab CI, GitHub Actions, Terraform, CloudFormation, Deployment Automation
Databases / Data Engineering: Vertica, PostgreSQL, MySQL, Redis, Data Marts, Data Warehousing, CTE, Window Functions, Query Optimization
Cloud Platforms: AWS, GCP, Azure, Lambda, EC2, S3, VPC
AI / ML / Data Science: Data Processing, Analytics Pipelines
Blockchain / Web3: Ethereum, Solidity
Testing / QA / Automation: Mocha, Chai, Jest, Cypress, Unit Testing, Integration Testing
Security / Observability / Compliance: TLS/SSL, Authentication, Authorization, Logging, Monitoring
Collaboration / Agile / Product Tools: Git, Jira, Confluence, Slack, Mattermost, Scrum, Kanban