As a seasoned Python Engineer and Data Engineering enthusiast, I bring extensive experience in developing robust data solutions using a diverse array of technologies. My expertise spans across FastAPI, SQLAlchemy, Django, Apache Kafka, Redis, and more.
- Backend Development: Skilled in designing and implementing scalable backend systems using frameworks like FastAPI and Django.
- Data Engineering: Proficient in creating efficient data pipelines with tools such as Apache Airflow, enhancing data processing efficiency and ensuring reliable data workflows.
- Big Data: Experienced with tools like Apache Airflow, Apache Kafka, Mageai, MinIO, and Elasticsearch, adept at handling and processing large datasets.
- Database Management: Extensive work with PostgreSQL, MongoDB, Neo4j, and MySQL, optimizing database schemas and queries to improve performance.
- ETL/ELT Processes: Expert in designing ETL/ELT workflows, ensuring seamless data integration and transformation.
- AI & ML: Developed intelligent systems including comment validation and trading strategies leveraging multi-threading and multiprocessing. Proficient in using large language models (LLM) and LangChain to develop advanced AI services.
- Comment Validation Systems: Reduced manual intervention by 80% with an intelligent comment validation system.
- Trading Strategies: Achieved a 60% reduction in strategy validation time through optimized concurrency techniques.
- Web Scraping Services: Created efficient web scraping services for dynamic data extraction and analysis.
- Data Visualization: Enhanced data-driven decision-making with tools like Metabase and Grafana.
- Programming Languages: Python, Node.js (JS, TS), Shell Scripting
- Frameworks & Tools: FastAPI, Django, Apache Kafka, Redis, Celery, Docker, Kubernetes, Terraform, Prometheus, Grafana
- Big Data & ETL: Apache Airflow, Mageai, MinIO, Elasticsearch, SQL, MongoDB, PostgreSQL
- AI & Machine Learning: LLM, LangChain, OpenAI
- CI/CD: GitHub Actions, GitLab CI, ClickUp
- Senior Python Developer & Data Engineer at Bit24: Enhanced system capabilities and user experience, and improved deployment efficiency through containerization.
- Senior Python Developer & Data Engineer at NeverStopMedia (Boof.ai): Optimized resource use with Celery, improved search capabilities with Elasticsearch, and developed dynamic AI services.
- Senior Python Developer at Edgecom: Modernized legacy systems, improving functionality and user satisfaction.
- Senior Python & Software Engineer at Digid: Boosted user engagement and integrated advanced AI technologies.
- Senior Python Engineer & Data Engineer at ArzDigital: Engineered advanced data solutions and optimized resource usage for large datasets.
I am a dedicated professional who believes in continual learning and staying up-to-date with the latest technologies. My goal is to deliver efficient, scalable, and secure solutions that address critical business needs and exceed expectations.
๐ I'm Everywhere
๐ Currently working remotely
๐ง Always learning and expanding my knowledge in Data Engineering