Java developer with experience in BigData

На данный момент Senior Software Engineer.

Мои компетенции и опыт

Ethan Lim

Singapore | нужен доступ к резюме | нужен доступ к резюме | нужен доступ к резюме

Summary

Senior software engineer with over 10 years of experience designing high-load microservices and processing large-scale streaming data. Skilled in Java, Apache Kafka, Spring, and microservice architecture patterns, with proven expertise in real-time data processing exceeding 10,000 RPS. Experienced in Kubernetes, Hadoop, Flink, Spark, and SQL optimization for terabyte-scale datasets. Delivered systems with low latency, high throughput, and high uptime, optimizing MTTR and operational efficiency.

Experience

Rescode | Senior Software Engineer May 2022 ~ Present

• Designed high-load microservices in Java, handling >12,000 RPS for financial and data platforms
• Implemented streaming data pipelines using Apache Kafka and Flink, processing terabytes of data daily
• Migrated backend services to Kubernetes, improving deployment scalability and resilience
• Developed SQL queries and window functions for real-time stateful processing, increasing throughput by 45%
• Built Helm charts for microservice deployment, reducing configuration errors and deployment time by 30%
• Optimized existing services with Spring, improving response latency by 120ms and uptime to нужен доступ к резюме %
• Monitored and profiled Big Data workflows, reducing MTTR for production incidents by 25%
• Led code reviews and architecture design for scalable, maintainable microservices
• Implemented secure data access controls and compliance checks with IAM and OAuth 2.0
• Automated CI/CD pipelines for deployment and testing of streaming services
• Mentored junior engineers in Java, microservices, and Big Data processing best practices
• Participated in Agile sprints, delivering critical features for high-load data platforms
• Integrated Spark jobs for batch processing alongside Flink streaming pipelines
• Conducted performance tuning of SQL queries and data storage schemas for large datasets
• Implemented monitoring and alerting for system metrics, reducing incident detection time by 40%
• Migrated legacy services to modern streaming architectures, increasing reliability and throughput
• Optimized memory and resource utilization for microservices, reducing operational cost
• Delivered measurable improvements in latency, throughput, and system scalability for Big Data platforms

Doodle Labs | Senior Full Stack Engineer Apr 2019 ~ Apr 2022

• Developed Java microservices handling high-load streaming data and API integrations
• Built Apache Kafka pipelines to process 8k+ messages/sec with low latency
• Designed SQL and NoSQL schemas optimized for large-scale real-time analytics
• Participated in Kubernetes migration, Helm chart creation, and CI/CD pipeline setup
• Led performance profiling and tuning for microservices, reducing response time by 95ms
• Implemented Spring-based services for batch and streaming workflows
• Automated data ingestion and ETL pipelines for terabyte-scale datasets
• Conducted code reviews and architecture improvements to support maintainability
• Ensured compliance with OAuth 2.0 and secure data access principles
• Mentored junior developers on Big Data frameworks, Java, and microservice design
• Monitored system metrics, alerting, and automated recovery for high-load services
• Optimized Spark and Flink jobs, increasing throughput and reducing latency
• Collaborated in Agile/Scrum teams, delivering high-priority features on schedule
• Delivered robust and scalable data pipelines supporting multiple internal services
• Automated deployment and testing processes, increasing team efficiency by 25%

Wise | Full Stack Engineer May 2015 ~ Feb 2019

• Developed mobile modules using Flutter and native integrations for complex financial applications
• Built and maintained scalable architectures supporting backend API consumption
• Implemented custom UI animations and graphics to enhance mobile UX
• Optimized performance and memory management across large applications
• Conducted unit and integration testing to ensure application reliability
• Integrated backend services, improving latency and throughput for critical operations
• Participated in code reviews and architecture design, improving maintainability
• Monitored performance metrics and debugged memory and rendering issues
• Mentored junior engineers in mobile development best practices
• Implemented CI/CD pipelines for mobile builds and automated testing
• Collaborated in Agile teams to deliver features and improvements on schedule
• Ensured secure storage and compliance with data protection standards
• Delivered measurable improvements in mobile app stability, performance, and scalability

Education

National University of Singapore Aug 2009 ~ Jul 2013

Bachelor’s Degree in Computer Science

Skills

Programming Languages & Frameworks: Java, Kotlin, Spring, Apache Flink, Apache Spark, Helm charts, REST API
Backend / API Development: Microservices, high-load systems, streaming systems, concurrency, data pipelines
DevOps / Infrastructure / CI-CD: Kubernetes, Docker, CI/CD pipelines, automated deployment, Helm
Databases / Data Engineering: SQL, Hadoop, PostgreSQL, data migration, window functions, stateful processing
Cloud Platforms: AWS, Azure, cloud-based Big Data deployments
Testing / QA / Automation: Unit testing, integration testing, automated pipelines, performance profiling
Security / Observability / Compliance: IAM, OAuth 2.0, Kerberos, secure data handling, compliance adherence
Collaboration / Agile / Product Tools: Agile/Scrum workflows, code review, cross-functional collaboration, JIRA, Confluence