Monday, July 1, 2013

ERROR working with Sqoop 1.99.2


Operating System : Debian / Ubuntu / BOSS Gnu Linux
pre-requisite : HBASE_HOME & ZOOKEEPER_HOME must be set in /etc/profile

while running  sqoop, I faced following error's, I resolved one but not all bec. current version of sqoop2 not compatible with apache hadoop & its not stable.

ERROR 1)


Exception has occurred during processing command 
Exception: com.sun.jersey.api.client.UniformInterfaceException Message: 
 GET http://localhost:12000/sqoop/v1/connector/all 
returned a response status of 404 Not Found

SOLUTION
set server properly


set server --host localhost --port 8050 --webapp sqoop
once I did above step, i got stuck by 
ERROR 2)

Exception has occurred during processing command 
Exception: com.sun.jersey.api.client.ClientHandlerException Message: 
java.net.ConnectException: Connection refused

ERROR 3)

Exception has occurred during processing command 
Exception: com.sun.jersey.api.client.UniformInterfaceException Message: 
GET http://10.184.39.34:80/sqoop

still this bug not resolved as sqoop2 is still in development.



















7 comments:

Anonymous said...

check the user you are trying to run the sqoop shell.
If it is someone else other than sqoop or sqoop2 then change it back to default and it should work fine...

this solution worked for me... let me know how it goes...

I'll be checking your blog for it...

arul said...

I'm also getting the same. also getting error " ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: java.sql.SQLException: No suitable driver found for jdbc:postgresql://localhost " while executing
sqoop-create-hive-table --connect jdbc:postgresql://localhost --table applicant_address --hive-table appAddr -username postgres -

Unknown said...

Am using Hadoop-2.2.0 on two node cluster, hadoop is configured correctly and working fine , Now am trying to install sqoop 2 (sqoop-1.99.3-bin-hadoop200) on it and when am trying to access sqoop 2 web UI (like localhost:12000) am getting the following .

Apache Sqoop ROOT

And when try to access localhost:1200/sqoop/version am getting following
HTTP Status 404 -
And when I use this in sqoop client

[stratapps@cloudera2 ~]$ sqoop.sh client
Sqoop home directory: /usr/local/sqoop2
Sqoop Shell: Type 'help' or '\h' for help.

sqoop:000> set server --host localhost --port 12000 --webapp sqoop
Server is set successfully
sqoop:000> show version --all
client version:
Sqoop 1.99.3 revision 2404393160301df16a94716a3034e31b03e27b0b
Compiled by mengweid on Fri Oct 18 14:15:53 EDT 2013
Exception has occurred during processing command
Exception: com.sun.jersey.api.client.UniformInterfaceException Message: GET http://localhost:12000/sqoop/version returned a response status of 404 Not Found

My catelina.proparties file for common.loader looks like

common.loader=${catalina.base}/lib,${catalina.base}/lib/*.jar,${catalina.home}/lib,${catalina.home}/lib/*.jar,${catalina.home}/../lib/*.jar,/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/*.jar,/usr/local/hadoop/hadoop-2.2.0/share/hadoop/common/lib/*.jar,/usr/local/hadoop/hadoop-2.2.0/share/hadoop/hdfs/*.jar,/usr/local/hadoop/hadoop-2.2.0/share/hadoop/hdfs/lib/*.jar,/usr/local/hadoop/hadoop-2.2.0/share/hadoop/mapreduce/*.jar,/usr/local/hadoop/hadoop-2.2.0/share/hadoop/mapreduce/lib/*.jar,/usr/local/hadoop/hadoop-2.2.0/share/hadoop/tools/*.jar,/usr/local/hadoop/hadoop-2.2.0/share/hadoop/tools/lib/*.jar,/usr/local/hadoop/hadoop-2.2.0/share/hadoop/yarn/*.jar,/usr/local/hadoop/hadoop-2.2.0/share/hadoop/yarn/lib/*.jar

my Sqoop.proprties file org.apache.sqoop.submission.engine.mapreduce.configuration.directory looks like

# Hadoop configuration directory
org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/usr/local/hadoop/hadoop-2.2.0/etc/hadoop


Please share your input I goggled a lot on this but dint find any solution yet.

Thankyou,
Malleshwar

dataanalytics said...

did u check sqoop 2 started successfully by
To start the sqoop server
sqoop.sh server start
To check sqoop started successfully
wget -qO - localhost:12000/sqoop/version

dataanalytics said...

@Malleshwar Rao,
find the detailed solution for the error

http://solaimurugan.blogspot.in/2014/05/exception-error-working-with-sqoop-2.html

Unknown said...

Hi,
Iam using sqoop-1.99.4

sqoop2 server is started
but when iam trying through programatically, Iam getting below error:
Exception in thread "main" com.sun.jersey.api.client.UniformInterfaceException: GET http://localhost:12000/sqoop/v1/connector/1 returned a response status of 404 Not Found
at com.sun.jersey.api.client.WebResource.handle(WebResource.java:676)
at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)
at com.sun.jersey.api.client.WebResource$Builder.get(WebResource.java:503)
at org.apache.sqoop.client.request.Request.get(Request.java:63)
at org.apache.sqoop.client.request.ConnectorRequest.read(ConnectorRequest.java:38)
at org.apache.sqoop.client.request.SqoopRequests.readConnector(SqoopRequests.java:94)
at org.apache.sqoop.client.SqoopClient.retrieveConnector(SqoopClient.java:188)
at org.apache.sqoop.client.SqoopClient.getConnector(SqoopClient.java:140)
at org.apache.sqoop.client.SqoopClient.newConnection(SqoopClient.java:273)
at com.zoho.mysqlbackup.Sqoop2Client.createConnection(Sqoop2Client.java:24)
at com.zoho.mysqlbackup.Sqoop2Client.main(Sqoop2Client.java:49)

But show version --all
client version:
Sqoop 1.99.4 source revision 2475a76ef70a0660f381c75c3d47d0d24f00b57f
Compiled by gshapira on Sun Nov 16 02:50:00 PST 2014
server version:
Sqoop 1.99.4 source revision 2475a76ef70a0660f381c75c3d47d0d24f00b57f
Compiled by gshapira on Sun Nov 16 02:50:00 PST 2014
API versions:
[v1]

Sqoop server is running.
please help me to avoid this above error

dataanalytics said...

kindly check the port 12000, its really listening .?