pyspark - SparkSQL read from MySQL database table using Python -

-

this question has answer here:

i have 'user' table in mysql. want read spark sql program. how can read table mysql apache spark's sparksql module using python? there connector can use task? thanks.

there similar question answered. start pyspark this

./bin/pyspark --packages mysql:mysql-connector-java:5.1.38

then run

sqlcontext.read.format("jdbc").options( url ="jdbc:mysql://localhost/mysql", driver="com.mysql.jdbc.driver", dbtable="user", user="root", password="" ).load().take(10)

this work. depends on mysql set-up, if doesn't try changing password, username, db-url , other settings.


Comments

Post a Comment

Popular posts from this blog

libGdx unable to find files in android application data directory -

-
Image
i'm trying access data application's data directory. i'm able load default.fnt file, tells me associated default.png cannot found. how can system recognize file? there i've setup incorrectly? exception 07-07 22:22:52.467: e/androidruntime(10785): fatal exception: glthread 240 07-07 22:22:52.467: e/androidruntime(10785): com.badlogic.gdx.utils.gdxruntimeexception: couldn't load file: /data/data/com.iliadonline.client/files/data/gfx/fonts/default.png 07-07 22:22:52.467: e/androidruntime(10785): @ com.badlogic.gdx.graphics.pixmap.<init>(pixmap.java:140) 07-07 22:22:52.467: e/androidruntime(10785): @ com.badlogic.gdx.graphics.glutils.filetexturedata.prepare(filetexturedata.java:64) 07-07 22:22:52.467: e/androidruntime(10785): @ com.badlogic.gdx.graphics.texture.load(texture.java:175) 07-07 22:22:52.467: e/androidruntime(10785): @ com.badlogic.gdx.graphics.texture.create(texture.java:159) 07-07 22:22:52.467: e/androidruntime(10785): @ com....
Read more

php - Webix Data Loading from Laravel Link -

-
trying load data webix data table using following code. looks browser getting json data back, webix isn't doing data. no datatable shows up, can still see full json under network -> response tab in firefox inspector. valid way of loading data webix? <script type="text/javascript" charset="utf-8"> dtable = new webix.ui({ container:"box", view:"datatable", select:"row", scroll:"xy", leftsplit:3, url: "{{ url('/getcontacts') }}", datatype: "json" }); </script> specifically, question around whether url work route 'getcontacts' returns json object. after troubleshooting webix, determined yes. using "{{ }}" does work webix, case, g...
Read more

python - Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>] error -

-
Image
i getting same error when python manage.py runserver. there no such error when have ubuntu 15.10. got started when upgraded ubuntu 16.04. question might duplicate have tried solution provided question have applied command dpkg --configure -a, have done apt-get update,upgrade,dist-upgrade, clean, -f install. have reinstalled python2.7 , python3 no success though. here screenshot while trying run django application i got after re-installing python please me? bashrc file # ~/.bashrc: executed bash(1) non-login shells. # see /usr/share/doc/bash/examples/startup-files (in package bash-doc) # examples # if not running interactively, don't case $- in *i*) ;; *) return;; esac export pythonhome="/usr/bin/python" echo $virtualenvwrapper_python echo 'tushant' # don't put duplicate lines or lines starting space in history. # see bash(1) more options histcontrol=ignoreboth # append history file, don't overwrite shopt -s histappend # setting h...
Read more