openmediavault-docker-gui Testing

subzero79 · 13. September 2015

I think we should add rtorrent by diameter to the repo.
I don't use rtorrent, but i spent once a whole day trying to run it. This one comes ready to start, no php, apache, libtorrent fiddling around.

edit: Also roaming today in the hub found this one

https://hub.docker.com/r/jwilder/nginx-proxy/ This will act as a reverse proxy for all containers exposing ports, passing the domain name as env var.

For this you will have to move the port 80 in omv to another one.

sfergu · 13. September 2015

Is there a specific reason why you'd need to run a reverse proxy inside of a docker plugin?

I was able to use reverse proxy for apps running inside and outside of docker by dropping a config file into the following directory:

Code

/etc/nginx/openmediavault-webgui.d/

Though it would be good to have a GUI in either each of the plugins or a separate "plugin".

Here's what I currently have (emby is the plugin running inside Docker), with OMV running on port 80 still:

Code

location /music {
    proxy_pass http://127.0.0.1:8181;
    proxy_set_header Host $host;
    proxy_set_header X-Real-IP $remote_addr;
    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
    auth_basic "Restricted";
    auth_basic_user_file /etc/nginx/.htpasswd;
}
location /movies {
    proxy_pass http://127.0.0.1:5050;
    proxy_set_header Host $host;
    proxy_set_header X-Real-IP $remote_addr;
    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
    auth_basic "Restricted";
    auth_basic_user_file /etc/nginx/.htpasswd;
}
location /tv {
    proxy_pass http://127.0.0.1:8989;
    proxy_set_header Host $host;
    proxy_set_header X-Real-IP $remote_addr;
    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
    auth_basic "Restricted";
    auth_basic_user_file /etc/nginx/.htpasswd;
}
location /emby {
    proxy_pass http://127.0.0.1:8096;
    proxy_set_header Host $host;
    proxy_set_header X-Real-IP $remote_addr;
    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
}

Alles anzeigen

subzero79 · 13. September 2015

No, in fact I wrote the guide in the section. This just provides a gui, ready to go for the dockers, no need to post nginx config a here, we all know how they work.

nicjo814 · 14. September 2015

@der-brumm-baer could you test and replace the plugin code in /etc/rc.local with the following code:

Code

### Do not change theese lines. They are added and updated by the OMV Docker GUI plugin.
DOCKERCONTAINERS=`docker ps -q | wc -l`
while [ $DOCKERCONTAINERS -gt 0 ]; do
    docker ps -q | xargs docker kill
    DOCKERCONTAINERS=`docker ps -q | wc -l`
done
DOCKERSERVICE=`ps aux | grep "/usr/bin/docker daemon" | grep -v grep | wc -l`
while [ $DOCKERSERVICE -gt 0 ]; do
   service docker stop
   DOCKERSERVICE=`ps aux | grep "/usr/bin/docker daemon" | grep -v grep | wc -l`
done
MOUNTPOINTS=`mount | grep /var/lib/docker/openmediavault | grep -v aufs | grep -v noexec | wc -l`
while [ $MOUNTPOINTS -lt 1 ]; do
    mount -o remount,bind,defaults /var/lib/docker/openmediavault
    MOUNTPOINTS=`mount | grep /var/lib/docker/openmediavault | grep -v aufs | grep -v noexec | wc -l`
done
for i in `seq 1 5`; do
    service docker start
    DOCKERSERVICE=`ps aux | grep "/usr/bin/docker daemon" | grep -v grep | wc -l`
    if [ $DOCKERSERVICE -eq 1 ]; then
       i=5
    fi
done
### End of OMV Docker GUI plugin changes.

Alles anzeigen

Then reboot and see if the permission denied problem is gone. This works on my test system, but so did the old code too...

nicjo814 · 14. September 2015

Zitat von subzero79

I think we should add rtorrent by diameter to the repo.

It's been added.

der-brumm-baer · 14. September 2015

Hello,

I put your code into the /etc/rc.local + two additional Logging Lines so it looks like this

Bash

#!/bin/sh -e
#
# rc.local
#
# This script is executed at the end of each multiuser runlevel.
# Make sure that the script will "exit 0" on success or any other
# value on error.
#
# In order to enable or disable this script just change the execution
# bits.
#
# By default this script does nothing.


### Do not change theese lines. They are added and updated by the OMV Docker GUI plugin.
#DOCKERSERVICE=`ps aux | grep "/usr/bin/docker daemon" | grep -v grep | wc -l`
#while [ $DOCKERSERVICE -gt 0 ]; do
#   DOCKERCONTAINERS=`docker ps -q | wc -l`
#   if [ $DOCKERCONTAINERS -gt 0 ]; then
#       docker ps -q | xargs docker kill
#   fi
#   service docker stop
#   DOCKERSERVICE=`ps aux | grep "/usr/bin/docker daemon" | grep -v grep | wc -l`
#done
#mount -o remount,bind,defaults /var/lib/docker/openmediavault
#service docker start
### End of OMV Docker GUI plugin changes.


logger -t DOCKER-INIT Start /etc/rc.local
### Do not change theese lines. They are added and updated by the OMV Docker GUI plugin.
DOCKERCONTAINERS=`docker ps -q | wc -l`
while [ $DOCKERCONTAINERS -gt 0 ]; do
    docker ps -q | xargs docker kill
    DOCKERCONTAINERS=`docker ps -q | wc -l`
done
DOCKERSERVICE=`ps aux | grep "/usr/bin/docker daemon" | grep -v grep | wc -l`
while [ $DOCKERSERVICE -gt 0 ]; do
   service docker stop
   DOCKERSERVICE=`ps aux | grep "/usr/bin/docker daemon" | grep -v grep | wc -l`
done
MOUNTPOINTS=`mount | grep /var/lib/docker/openmediavault | grep -v aufs | grep -v noexec | wc -l`
while [ $MOUNTPOINTS -lt 1 ]; do
    mount -o remount,bind,defaults /var/lib/docker/openmediavault
    MOUNTPOINTS=`mount | grep /var/lib/docker/openmediavault | grep -v aufs | grep -v noexec | wc -l`
done
for i in `seq 1 5`; do
    service docker start
    DOCKERSERVICE=`ps aux | grep "/usr/bin/docker daemon" | grep -v grep | wc -l`
    if [ $DOCKERSERVICE -eq 1 ]; then
       i=5
    fi
done
### End of OMV Docker GUI plugin changes.
logger -t DOCKER-INIT Ende /etc/rc.local


exit 0

Alles anzeigen

Therefore the messages "DOCKER-INIT Start /etc/rc.local" appears in /var/log/syslog
But i don't get the end Message

df -h gives the following

Code

Dateisystem                                            Größe Benutzt Verf. Verw% Eingehängt auf
rootfs                                                  7,4G    4,0G  3,1G   57% /
udev                                                     10M       0   10M    0% /dev
tmpfs                                                    50M    464K   49M    1% /run
/dev/disk/by-uuid/fd5aa10c-e311-4c0c-8683-92cfb3e425de  7,4G    4,0G  3,1G   57% /
tmpfs                                                   5,0M       0  5,0M    0% /run/lock
tmpfs                                                   176M       0  176M    0% /run/shm
/dev/sdb1                                                20G     45M   20G    1% /media/3be179f1-269f-40ce-bcab-d5ea8ae755dd
/dev/sdc1                                                20G     45M   20G    1% /media/fa7865a4-2fb3-4da2-8af6-5d13861c3d0a
/dev/sde1                                                20G    2,5G   18G   13% /media/148fec83-bb0d-4039-beeb-dcebfef3425a
/dev/sdd1                                                20G     45M   20G    1% /media/7f8e400a-4a91-4379-bb8b-3175203b0446
/dev/sde1                                                20G    2,5G   18G   13% /var/lib/docker/openmediavault
cgroup                                                  248M       0  248M    0% /sys/fs/cgroup
/dev/sde1                                                20G    2,5G   18G   13% /var/lib/docker/openmediavault/aufs

Alles anzeigen

So it looks like the /etc/rc.local doesn't finish to the end and i end up with permission denied

der-brumm-baer · 14. September 2015

Hello,

I did another test,

I put an logger entry after every "while" loop and after the "for" loop

So the while loops finish, but the for loop seems not to finish but docker is still up and running but I can't start a container

der-brumm-baer · 14. September 2015

Hello

I simply tried this in /etc/rc.local

Code

logger -t DOCKER STOP PID `pidof docker`
service docker stop
logger -t DOCKER STOPPED `pidof docker`
mount -o remount,bind,defaults /var/lib/docker/openmediavault
logger -t DOCKER MOUNT
service docker start
logger -t DOCKER STARTED `pidof docker`

I did x reboots and everytime my containers started

nicjo814 · 14. September 2015

I did have it like that from the beginning but had quite some issues with it. Could you test to change the code:

Code

if [ $DOCKERSERVICE -eq 1 ]; then
       i=5
    fi

to:

Code

if [ $DOCKERSERVICE -eq 1 ]; then
break
    fi

But with proper indentation

der-brumm-baer · 14. September 2015

still the same behaviour

nicjo814 · 14. September 2015

If I remove the for loop completely and only keep the service docker start line in itself and put the logging line AFTER that command, nothing shows in syslog. However if I move the logging BEFORE the start of docker service it shows up in the log. I just love the Docker service...

der-brumm-baer · 15. September 2015

Hello,

after I've found this about runtime of docker init script
https://github.com/docker/docker/issues/11181
and this about failures in /etc/rc.local
http://askubuntu.com/questions…nd-what-can-i-do-about-it

I moved the stopping / mounting / starting part to an extra script in /usr/local/bin and started this through /etc/rc.local
Maybe this could be an solution

/usr/loca/bin/dockerremount

Bash

#!/bin/bash
if [ -f /var/run/docker.pid ]
then
        pid="`cat /var/run/docker.pid`"
        logger -t DOCKER-OMV Docker is running with PID $pid
else
        pid="0"
        logger -t DOCKER-OMV Docker is not running
fi


if [ -f /var/run/docker-ssd.pid ]
then
        pidssd="`cat /var/run/docker-ssd.pid`"
else
        pidssd="0"
fi


if [ $pid -eq 0 ]
then
        if [ -f /var/run/docker-ssd.pid ]
        then
rm /var/run/docker-ssd.pid
        fi
else
        logger -t DOCKER-OMV Stopping Docker with PID $pid


        service docker stop
        pid=`pidof docker`
        while kill -0 $pid > /dev/null 2>&1
        do
                sleep 1
                logger -t DOCKER-OMV Still Stopping Docker with PID $pid
        done
        if [ -f /var/run/docker-ssd.pid ]
        then
 rm /var/run/docker-ssd.pid
               logger -t DOCKER-OMV Deleting docker-ssd.pid fom PID $pid
        fi


fi


mount -o remount,bind,defaults /var/lib/docker/openmediavault


logger -t DOCKER-OMV MOUNTED


service docker start


logger -t DOCKER-OMV STARTED `pidof docker`


exit 0

Alles anzeigen

and in /etc/rc.local I only put

Code

/usr/local/bin/dockerremount

Maybe the parts about /var/run/docker-ssd.pid are not needed

nicjo814 · 15. September 2015

Wow! Really good info! However I have an issue on my system with the service not stopping with your script (even though the line in syslog is there saying it's been stopped). This results in two mount lines pointing to /var/lib/docker/openmediavault (one with noexec and one without).

nicjo814 · 16. September 2015

@der-brumm-baer Could you try with this code in dockerremount script:

Bash

#!/bin/bash
logger -t DOCKER-OMV Stopping Docker service
DOCKERSERVICE=`ps aux | grep "/usr/bin/docker daemon" | grep -v grep | wc -l`
if [ $DOCKERSERVICE -gt 0 ]; then
    service docker stop
    DOCKERSERVICE=`ps aux | grep "/usr/bin/docker daemon" | grep -v grep | wc -l`
fi


while [ $DOCKERSERVICE -gt 0 ]; do
    logger -t DOCKER-OMV Waiting for Docker service to stop
    sleep 1
    DOCKERSERVICE=`ps aux | grep "/usr/bin/docker daemon" | grep -v grep | wc -l`
done
logger -t DOCKER-OMV Docker service stopped
mount -o remount,bind,defaults /var/lib/docker/openmediavault
logger -t DOCKER-OMV Mounted /var/lib/docker/openmediavault
service docker start
logger -t DOCKER-OMV Docker service started


exit 0

Alles anzeigen

This works for me and should let the Docker service exit properly.

EDIT: I had two entries in fstab which caused the previous issue... This code should however work fine when fstab is correct...

der-brumm-baer · 16. September 2015

Hello,

I tried your script and my script in a virtualbox vm and on real hardware
both failed on each system, but not everytime.
Yesterday my script worked on both but today no success
At the moment i have no idea what to try next, maybe a combination of both, or changing the init script of docker to remount
during startup

nicjo814 · 16. September 2015

Do you know how it failed? Service not stopping, not mounting with correct options etc.

nicjo814 · 17. September 2015

Ok, new approach... Forget about rc.local and add an entry to root's crontab instead. Now I just have to test this thoroughly and automate the process of adding/removing entries in crontab...

der-brumm-baer · 17. September 2015

Hello,

I did a short test with

crontab -e

adding this line

Code

@reboot /usr/local/bin/dockerremount.sh

My script work in 3 out of 3 reboots on my real hardware setup
Your Script hangs while trying to stop the service

I received your Mail now, the checks above i did with the old version

nicjo814 · 17. September 2015

I changed the script also in the version I sent to you.

der-brumm-baer · 17. September 2015

Hello,

I have tested the version you sent me.
Everything worked flawlessly. Even after x reboots
No problems with permissions

Jetzt mitmachen!