Find Jobs
Hire Freelancers

Cloudera Expert needed for performance tuning for HDFS/Spark/Yarn environment

$30-250 USD

In Progress
Posted about 3 years ago

$30-250 USD

Paid on delivery
Cloudera Expert needed for performance tuning for HDFS/Spark/yarn environment - Need to optimize performance through configuration of server environment resource utilization (mem and CPU) on 4 node environment running cloudera 5.11. Platform runs very well but need to optimize for larger jobs. The project success criteria requires that the sentiment analysis yarn job dataset complete successfully within a few hours run time at most.
Project ID: 29815887

About the project

5 proposals
Remote project
Active 3 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
I has to work on this in two steps i.e. yarn tuning and spark tuning. I will deliver it in 3 days. on similar project worked a lot. I am looking forward to work with you.
$30 USD in 3 days
0.0 (0 reviews)
0.0
0.0
5 freelancers are bidding on average $124 USD for this job
User Avatar
Hi, I have more than 4 years of experience in the big data field. During this period I have worked on many spark and Hadoop applications. I have a lot of experience tuning spark applications for performance by changing the spark submit parameters like executor memory, number of cores, overhead memory, broadcast threshold and many more. I also understand the spark resource manager page very well and hence can also identify issues like data skew or some other issue in the code or query which might be the cause of the bottleneck. I am confident that I will be able to resolve your issue because of my background in this field. Kindly provide me with further details and I can start working on it right away. Regards, Amith
$222 USD in 7 days
5.0 (4 reviews)
2.4
2.4
User Avatar
hi i am working as big data hadoop admin i will fine tuning your cloudera cluster an your cluster will run faster . more discuss in chat .
$30 USD in 1 day
3.3 (2 reviews)
1.9
1.9
User Avatar
I have been into Cloudera Hadoop Administration from last 6 years, and maintaining large scale production hadoop clusters .
$140 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have 9 years of experience in Big Data Techologies. Also have achieved high throughput low latency results in Spark with HDFS in the past. I can help you to fine tne your job to run within specified time.
$200 USD in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Novato, United States
4.9
12
Payment method verified
Member since Aug 6, 2015

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.