Questions tagged [hadoop]
Hadoop is an open-source software framework for distributed storage and distributed processing of very large data sets on computer clusters built from commodity hardware
96
questions
0
votes
0
answers
45
views
YARN resource manager "HTTP request sent, awaiting response..."
we have Hadoop cluster with active/stand by resource manager services the active resource manager is on master1 machine and the stand by resource manager is on master2 machine
in our cluster YARN ...
- 871
0
votes
1
answer
31
views
How to config trust between two realms in one KDC?
I'm using one KDC to manage two realms in two different databases (like krb5kdc -p 2001 -r REALM1 -p 2002 -r REALM2), how can I config them to trust each other? I know the steps when it's in two ...
0
votes
1
answer
334
views
Druid coordinator cannot talk to the rest of the cluster
I'm deploying a 5-KVM cluster with Hadoop, Spark and Apache Druid for testing purposes, and I'm stuck on an issue about Druid. The running cluster is organized as this:
hadoop-master: also hosts ...
1
vote
0
answers
435
views
SSH to localhost keeps asking for password on MacBook Air M1
I am trying to install hadoop on my MacBook Air M1 and when I write start-all.sh in terminal it prompts
fatix@localhost: Permission denied (publickey,password,keyboard-interactive).
I did following ...
- 11
0
votes
0
answers
1k
views
SSH into WSL2 from another machine outside local network
I'm trying to deploy a distributed systems hadoop framework project. Thus, I downloaded and installed WSL2 on my personal PC and created 2VMs as Linux Servers. Now, I need to SSH into the master node (...
- 1
-1
votes
1
answer
69
views
RHEL + can we improve disks performance by tuning kernel parameters?
we have Hadoop cluster and we are collection metrics collection data in order to investigate slowness behavior on spark applications
after long investigation on our Hadoop cluster
we noticed from ...
- 871
0
votes
1
answer
10k
views
kernel parameter - net.core.netdev_max_backlog , what happened when its too low
we want to understand what are the aspects when net.core.netdev_max_backlog kernel value is very low and not as recommended
on our Linux RHEL machines , the value for this parameter is 1000
since our ...
- 871
0
votes
0
answers
478
views
How do I get Hadoop / Spark running on Windows? I need to run an IDE, do unit testing, set breakpoints - running under Docker container will not do
How do I get Hadoop to run on Windows 10 Pro x64 (AMD)?
Every stackoverflow article, and even the documentation at Hadoop is years old and out of date, and does not work, something has changed and the ...
- 121
0
votes
2
answers
774
views
ssh between two ubuntu machines via WAN
We are trying to set-up a two-nodes hadoop clusters on two different machines.
SSH to localhost without password have been setted up on both machines. And hadoop can run well as single node on each ...
-2
votes
1
answer
2k
views
localhost : ERROR: ssh: connect to host localhost port 22: Address not available
Newbie to docker, trying to set up Hadoop container for which I first create ssh-server container for easy debug as my first container is working fine am able to login
ssh localhost
within the ...
- 111
2
votes
0
answers
109
views
How to avoid (skip) full datanodes on write or replica process
I started a small hadoop cluster for experiment purpose, in my own hardware, with three datanodes with 30GB disk space. Later I added two more nodes with 200GB and now my cluster has approximately ...
0
votes
0
answers
526
views
hadoop daemons not starting
I have followed this tutorial to install hadoop on an Ubuntu 18.04 Virtual Machine (4 cores and 10 gb of ram) with learning purposes. I have successfully followed all the steps without any errors. ...
4
votes
2
answers
5k
views
I can't run hive in command line
Hive 3.1.2
Hadoop 3.2.1
When I run hive in command line, it tell me the error message below:
which: no hbase in (/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin)
SLF4J: Class path ...
- 143
1
vote
2
answers
3k
views
Hadoop 3.2.1 namenode formatting not working
I am having [what sounds like] the same issue to Hadoop 3.2.1 namenode formatting
Per request to ask this as a new question, and also provide more details:
This happens on a Desktop, Windows 10, ...
- 11
0
votes
0
answers
38
views
cloudera manager cluster installation step5 (Installing Selected Parcels ) stuck
I use the vmware provided by the official website to add a new cluster action and try to use two nodes for deploy. Repeating it several times is always stuck at this stage and i can't find the problem....
