Questions tagged apache-zeppelin

Explore the latest questions and answers asked by our top developers.

How to pass a variable into an Pyspark sequence to generate time series?

I want to generate a time series, from 2021-12-01 to 2021-12-31, but I want to pass the values with variables into de function secuence. This is my code: spark = SparkSession.builder.appName(‘sparkdf’).getOrCreate() TyP_dias = spark.createDataFrame([(‘null’,’null’)], [‘MES’,’NEGOCIO’]) TyP_df0 = TyP_dias.withColumn(‘FECHA’, sf.explode(sf.expr("sequence(to_date(‘2021-12-01’), to_date(‘2021-12-31’), interval 1 day)"))).show() I want the values 2021-12-01 and 2021-12-31 inside variables. Something like: spark […]

By Artemination
Published
Categorised as apache-zeppelin, docker, pyspark, python Tagged , , ,

Unable to install R package in Zeppelin Docker

I have a docker container apache/zeppelin:0.9.0 successfully running. The name of the container is "zeppelin". I’ve tried to install "RPostgres" package by running following command: docker exec -it -u root zeppelin R -e "install.packages(‘RPostgres’, repos = ‘http://cran.us.r-project.org’)" but following error message is shown for every dependency compilation: /opt/conda/bin/../lib/gcc/x86_64-conda-linux-gnu/9.3.0/../../../../x86_64-conda-linux-gnu/bin/ld: cannot find -lgcc Source: Docker Questions

By ssoria
Published
Categorised as apache-zeppelin, docker, gcc, r, rpostgres Tagged , , , ,

Cannot install packages inside Docker image based of apache/zeppelin:0.9.0

I have created a Dockerfile from the apache/zeppelin:0.9.0 base image that installs jq inside my docker image: FROM apache/zeppelin:0.9.0 RUN apt-get update && apt-get install -y jq When I build this image using docker build . I get the following error message: [2/2] RUN apt-get update && apt-get install -y jq: #5 0.257 Reading package […]

By Endre
Published
Categorised as apache-zeppelin, docker, jq Tagged , ,

Deploying Zeppelin with additional Python packages

On my Homeserver I’m running Apache Zeppeling within a Docker container: sudo docker run -d -p 8080:8080 -v $PWD/logs:/logs -v $PWD/notebook:/notebook -e ZEPPELIN_LOG_DIR=’/logs’ -e ZEPPELIN_NOTEBOOK_DIR=’/notebook’ –name zeppelin apache/zeppelin:0.9.0 Everything works well, but how could I add additional Python packages that I don’t have to install them all the time again? Now I’m going into the […]

By Marco CH
Published
Categorised as apache-zeppelin, docker Tagged ,

Apache.Zeppelin Docker+SQL Server

I try to work with SQL Server data using Apache.Zeppelin Docker image. Run this docker docker run –name zeppelin -p 8088:8080 -v /zeppelin-sqlserver/notebook -v /zeppelin-sqlserver/conf -d yorek/zeppelin-sqlserver:latest Run Zeppelin GUI http://localhost:8080 Edited the interpreter SQL Server: entered my SQL Server instance name, database, user name, password Created the note in Notebook. All is ok, but […]

By ZedZip
Published
Categorised as apache-zeppelin, docker, sql-server Tagged , ,

(Docker) Connect Zeppelin Container with Hadoop Container

I’m a Docker newby and I’m failing connecting Zeppelin (Container) with Hadoop (also in a Container). Zeppelin Container setup: docker run -d -p 8080:8080 -v /home/marco/zeppelin_notebooks:/opt/zeppelin/notebook –name zeppelin apache/zeppelin:’0.9.0′ And Hadoop setup: docker run -it –name hadoop -p 9864:9864 -p 9870:9870 -p 8088:8088 -v "$PWD":/home/hduser/data –hostname localhost hadoop In core-site I specified: <configuration> <property> <name>fs.defaultFS</name> […]

By Marco CH
Published
Categorised as apache-zeppelin, docker, hadoop Tagged , ,

install zeppelin with spark in docker-compose

I was trying to install zeppelin as shown in this dockerfile, but with a different version of spark and hadoop (see this dockerfile in my repo for more details). However, I am getting the following error log when running apt-get update: Step 5/10 : RUN apt-get update —> Running in 1ee84513acc7 Ign http://ftp.debian.org jessie-backports InRelease […]

Setup zeppelin in docker without use built-in image

I need to install zeppelin in docker without use build-in image, because it’s huge size (in gb). So i want to install zeppelin from binary file, example zeppelin-0.8.2-bin-netinst.tgz (Only spark interpreter ~ 318 mb) My Dockerfile FROM openjdk:8 RUN wget -O /tmp/zeppelin-0.8.2-bin-netinst.tgz https://mirror.downloadvn.com/apache/zeppelin/zeppelin-0.8.2/zeppelin-0.8.2-bin-netinst.tgz RUN tar -xvzf /tmp/zeppelin-0.8.2-bin-netinst.tgz -C /opt && rm /tmp/zeppelin-0.8.2-bin-netinst.tgz EXPOSE 8080 And […]

By qxk71551
Published
Categorised as apache-zeppelin, docker Tagged ,

How to conect Zeppelin image with cassandra on host server

Docker is something new to me and I don’t even have average skills in it, but I’m tring to create specific Zeppelin image with some installed libraries. Ther is my Dockerfile: FROM apache/zeppelin:0.9.0 ENV SPARK_VERSION=2.4.6 USER root RUN apt-get -y update && apt-get install sudo ENV SPARK_HOME=/opt/conda/lib/python3.7/site-packages/pyspark RUN installing some libraries… And my question is […]

By MasBar146
Published
Categorised as apache-spark, apache-zeppelin, cassandra, docker, dockerfile

Anaconda docker user permissions

I’m struggling with some issue related with container user permissions. I’ve created an image from this dockerfile. As you can see, at line 128 it’s changing to USER 1000. I’m trying to play with anaconda using this command: $ conda install pandas Collecting package metadata (current_repodata.json): failed NotWritableError: The current user does not have write […]

By Jordi
Published
Categorised as anaconda, apache-zeppelin, docker, kubernetes
1 2

Still Have Questions?


Our dedicated development team is here for you!

We can help you find answers to your question for as low as 5$.

Contact Us
faq