Find Jobs
Hire Freelancers

Apache kafka Integration with bigdata and other appliction

$250-750 USD

Closed
Posted about 1 year ago

$250-750 USD

Paid on delivery
We have a apache kafka running in docker, which have topics and streams in to process data and generate alert. Need to understand the project and integrate it with big data and other softwares.
Project ID: 36104106

About the project

18 proposals
Remote project
Active 1 yr ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
18 freelancers are bidding on average $558 USD for this job
User Avatar
Hi there, I believe I can help you with this project as i have the experience with Big Data, Java, Apache Kafka, Linux and Docker. here is my portfolio: https://www.freelancer.com/u/ayesha0124
$750 USD in 7 days
5.0 (4 reviews)
5.1
5.1
User Avatar
مرحبا sir, I am professional web developer have a look at my profile having nice ratings and reviews Your satisfaction is more important than money then you only need to pay when your project is completed. There are no risk for you. Best regards, Michael
$504 USD in 8 days
5.0 (9 reviews)
4.5
4.5
User Avatar
Full-Stack Engineer with over 6 years experience in backend development using Java, Python, Golang, MySQL, Django, Go, React, Hibernate, and C++. Passionate about finding solutions to problems that the user has knowing how far the functionalities can be compromised in order to get a solution that is balanced between resources, quality and time.
$400 USD in 2 days
4.9 (5 reviews)
4.3
4.3
User Avatar
Hi, I have good experience in big data processing in Linux server using Apache Kafka. Especially, I am familiar with Docker containerization management. I am sure I can exceed your expectation. Let's discuss more details via chat. Thank you. Boban
$750 USD in 7 days
5.0 (2 reviews)
3.3
3.3
User Avatar
Good day Recruiter, I hope you had a great day. I’m David, a DevOps and Site Reliability Engineer with a focus on Python Automation and Artificial Intelligence. For the past 6 years, I have been building DevOps infrastructure for companies as a DevOps contractor. Which includes Big Data infrastructures, multi container Kubernetes orchestration, large clusters of (100 - 500 nodes) and many more security orchestration using tools like Azure Active Directory and AWS IAM. My stacks includes but not limited to: Language: - Python - YAML - Java - Ruby - Grovy - HCL Cloud Engineering: - AWS - Azure - GCP Software Delivery: - Docker - Kubernetes - Openshift - Rancher Infrastructure as Code: - Ansible - Terrform - Puppet - Chef - Saltstack Continuous Integration, Deployment and Delivery: - Jenkins - Spinnaker. - Azure DevOps Observability: - Elastic Search - Logstash - Kibana - Prometheus - Grafana - Jaeger - Zipkin. Every one of these tools are my arsenal for working magic for the past 6 years. I have contributed a number of open source projects and award projects including Microsoft and Helios. It would be an honor to work with your internal and extended team to provision a futuristic infrastructure for your establishment. Hope to hear from you, David.
$500 USD in 2 days
5.0 (3 reviews)
3.4
3.4
User Avatar
Hello, I have over 5 years of experience working with the ELK stack, including Elasticsearch, Logstash, and Kibana. In my previous projects and a production-level project at a telecommunications company, I have gained the following experience: • Maintaining Elasticsearch clusters • Setting up and maintaining message brokers such as Kafka and RabbitMQ • Using Graylog to monitor and manage input data • ETL processes for moving data between platforms • Creating management dashboards with Kibana • Implementing CDC mechanisms using Logstash on Linux platforms • Maintaining a cluster of 60 Elasticsearch servers with 35 TB hard drives and 300 GB of RAM • Setting up Prometheus for monitoring Linux host metrics Above project was exactly as the same as your requirement which was for collecting logs in a big scale , and we had about 40K TPS for our logs from Kafka and RebbitMQ, if Elasticsearch and ELK Stack tools working for you as a log management system please let me know. I am eager to assist you with this project and believe that my skills and experience align with the requirements of the project. Sincerely, Yaser
$750 USD in 15 days
5.0 (1 review)
3.1
3.1
User Avatar
Hey dhinilkv1 I am ready and available to work on your project. I have a strong knowledge of Java, Linux, Docker, Apache Kafka, Big Data. I have strategized and built similar projects. I would really recommend having a quick meeting to discuss the action plan. I would be glad to show you more of my relevant project during our meeting or over the chat box. Regards, Aqib
$740 USD in 7 days
5.0 (1 review)
2.8
2.8
User Avatar
Hello, This is in response to your job notification for the position of Professional for your project. I have been working as a developer  for the last 8+ years with a software firm and  mentioned below are some of my achievements in this role: - Designed and developed a conversion plan for 100+ Uniface modules into equivalent Java/J2EE. - Managed a project team developing a Java/MySQL based web application/Window Application - Converted a user based web application to a Java/J2EE application for better performance. I’m well versed with: - Designing database architecture and server scripting - Studying and establishing connectivity with network systems, search engines, and information servers. - Developing knowledge and understanding of the technical environmentincluding program compilation, file structures and program interfaces in the Java EE environment. I have a full understanding of Designing and development of Java Technology. Expertise in JSP/Servlet/Collection/JDBC , Framework - Spring/Hibernate, API -iText/POI/iPerf, Database(Oracle/MySQL/PostgreSQL/MongoDB),Should you need any more details, please do let me know. Thanking you for your time and looking forward to hear from you. Regards Vivek
$500 USD in 7 days
5.0 (6 reviews)
2.8
2.8
User Avatar
Hi there,I am excited to share my expertise and skills in Kafka, which I have acquired over the past 3 years. I am confident that I can meet your requirements. I would be delighted to work with you and I look forward to hearing more about the project if you are interested. Ps. I've worked on many projects using kafka, if you wanna proof just contact me
$600 USD in 4 days
5.0 (3 reviews)
2.4
2.4
User Avatar
Dear Client, Thank you for considering WizBuilders for your project. Our team of experienced developers has extensive knowledge of Apache Kafka and its integration with big data and other applications. We are confident that we can provide you with the best possible solution and exceed your expectations. Here are the plans and steps of execution we will follow for this project: Analysis of current system: We will start by analyzing your current Apache Kafka setup and its topics and streams. This analysis will help us understand how the data is being processed and how the alerts are generated. Planning and designing: Based on the analysis, we will plan and design the architecture for integrating Apache Kafka with big data and other applications. Integration and testing: After planning and designing, we will proceed with the integration of Apache Kafka with big data and other applications. We will perform testing to ensure that the integration is working as expected and all data is being processed accurately. Deployment and monitoring: Once the integration is complete, we will deploy the solution to your production environment. We are confident that our team of experienced developers can provide you with the best possible solution. We are committed to delivering high-quality work that meets your expectations. Thank you for considering WizBuilders. We look forward to working with you on this project. Best regards, WizBuilders Team
$700 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi Please find the project i did on multiple clients.  Project Completed: o Authenticate Azure Active Directory Users with AWS QuickSight to get Business Report from Teradata. o E-Commerce Website Real Time click stream analysis using Kafka and Spark o Detect Real Time Transaction Alert, AWS Kinesis, Kinesis Analytics, Lambda, and SNS o Prepare data for Amazon Personalize to create E-Commerce Recommendation System o Retrieve Order status from database using JDBC connection on AWS Glue, Schedule AWS Crawler to every minute, run query on Teradata to show count of Open, Closed, Pending, Order status on QuickSight Dashboard o Retrieve Compliant status from database using JDBC connection on AWS Glue run query to show count of Open, Closed, Pending Order status on QuickSight Dashboard o Build LSTM model to forecast stocks price, o Sentiment Analysis Application of Twitter and Google News and Integrate with Node JS o Predict Sales revenue using Machine learning, o Build Spring Boot application using Microservice such as API Gateway, Cloud Config Server, Service Registry, Resilience4j, Prometheus Grafana, Elasticsearch, Zipkin on Kubernetes Cluster o Created Pipeline of Java Spring Boot application to push code on Git, then using Git Action, create Code image, and Push to Kubernetes cluster as Microservice
$300 USD in 15 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I am a developer with a strong background in data analysis, statistical modeling and data visualization. Proficient in software tools such as Excel, Power BI, Python, Spark, Hadoop. A great project to apply plantiadas technologies, and automate the entire process with a pipeline. This is why this proposal adapts very well to my skills and I can present a solution with great scalability and persistence.
$400 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
My expertise in distributed systems and cloud technologies, including Azure, and Microsoft certifications, make me an asset to customers and the organization. Not only do I provide expert advice and support on Azure services, but I also assist customers in migrating to the cloud.
$750 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED ARAB EMIRATES
Dubai, United Arab Emirates
0.0
0
Member since Jan 30, 2023

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.