Bad Network Performance with OSX

  • Hello!
    After fiddling around with F...Nas for some time i stumbled over OMV .... great, exactly what i was looking for. Thanks a lot to Volker for this great project!


    But unfortunately i encountered some performance issues.


    Configuration:


    TEST MACHINE:
    Apple MBP Retina, last gen, SSD, connected with Thunderbolt Ethernet Adapter to Gigabit Switch


    F...NAS:
    HP N54 Microserver, 16GB Ram, USB Boot, 4x3TB HDD with ZFS, F...NAS 9.2.1.7


    OMV:
    HP N54 Microserver, 4GB Ram, SSD Boot, 4x2TB HDD Raid5/XFS, OMV 5.x and OMV 1.x (tested both, latest versions)


    ---


    Raw Network performance:


    Both are equal.
    From the Mac to the Machines i get 945MBit/s TCP and 1.05Mbit/s UDP Performance with iperf 2.0.5, so they seem ok (i know there were some problems with the onboard NIC from broadcom in these machines, but read on)


    ---


    SCP:


    Here OMV is faster (tested only with OMV 5.x).
    2.8 GB iso file copied from Mac


    OMV (to SSD root drive and to RAID):
    100% 2821MB 65.6MB/s 00:43 (SSD)
    100% 2821MB 70.5MB/s 00:40 (RAID)
    (same file copied local with the shell from SSD to Raid: 12.5sec and from Raid to SSD: 27sec ... so the storage seems not to be the bottleneck)


    F...NAS (to ZFS Raid):
    100% 2821MB 45.5MB/s 01:02


    ---


    SMB:


    Here i tested with two Tools. XBench and Blackmagic Disk Speed Test.


    Doesnt look so good for OMV


    F...Nas:
    Results 76.65
    System Info
    Xbench Version 1.3
    System Version 10.9.4 (13E28)
    Physical RAM 16384 MB
    Model MacBookPro11,3
    Disk Test 76.65
    Sequential 45.77
    Uncached Write 20.28 12.45 MB/sec [4K blocks]
    Uncached Write 153.26 86.72 MB/sec [256K blocks]
    Uncached Read 39.33 11.51 MB/sec [4K blocks]
    Uncached Read 162.91 81.88 MB/sec [256K blocks]
    Random 235.80
    Uncached Write 95.30 10.09 MB/sec [4K blocks]
    Uncached Write 282.38 90.40 MB/sec [256K blocks]
    Uncached Read 1545.64 10.95 MB/sec [4K blocks]
    Uncached Read 438.07 81.29 MB/sec [256K blocks]


    OMV 5.x:
    Results 66.86
    System Info
    Xbench Version 1.3
    System Version 10.9.4 (13E28)
    Physical RAM 16384 MB
    Model MacBookPro11,3
    Disk Test 66.86
    Sequential 39.63
    Uncached Write 18.82 11.56 MB/sec [4K blocks]
    Uncached Write 108.92 61.63 MB/sec [256K blocks]
    Uncached Read 33.49 9.80 MB/sec [4K blocks]
    Uncached Read 113.90 57.25 MB/sec [256K blocks]
    Random 213.70
    Uncached Write 105.07 11.12 MB/sec [4K blocks]
    Uncached Write 193.17 61.84 MB/sec [256K blocks]
    Uncached Read 1331.81 9.44 MB/sec [4K blocks]
    Uncached Read 305.60 56.71 MB/sec [256K blocks]


    OMV 1.14:
    Results 65.29
    System Info
    Xbench Version 1.3
    System Version 10.9.4 (13E28)
    Physical RAM 16384 MB
    Model MacBookPro11,3
    Disk Test 65.29
    Sequential 38.37
    Uncached Write 18.97 11.65 MB/sec [4K blocks]
    Uncached Write 108.23 61.24 MB/sec [256K blocks]
    Uncached Read 29.86 8.74 MB/sec [4K blocks]
    Uncached Read 113.61 57.10 MB/sec [256K blocks]
    Random 218.64
    Uncached Write 111.54 11.81 MB/sec [4K blocks]
    Uncached Write 191.20 61.21 MB/sec [256K blocks]
    Uncached Read 1172.77 8.31 MB/sec [4K blocks]
    Uncached Read 308.02 57.15 MB/sec [256K blocks]


    Its not that much, but it gets worse:


    Blackmagic Disc Speed Test (simulates reading and writing of files for video editing), 5GB stress test:


    F...Nas:Write 107MB/s, Read 103.5MB/s


    OMV Kralizec:Write 60MB/s, Read 61MB/s


    OMV 5.x:Cant remember exactly, but it was worse ... write between 60 and 15MB/s !!!



    So my question: Why oh Why???


    Tom

    Tom


    ----


    HP N54L, 6GB, 5disc Raid5, SSD Boot with OMV 5
    HP N54L, 16GB, 4disc ZFS pool, SSD Boot with other NAS system

  • Forgot to add .... two Intel NICs are on order, but i dont think its a driver issue. The 4gb ram on the OMV rig is enough for the moment, cpu is never maxed out on both machines

    Tom


    ----


    HP N54L, 6GB, 5disc Raid5, SSD Boot with OMV 5
    HP N54L, 16GB, 4disc ZFS pool, SSD Boot with other NAS system

    • Offizieller Beitrag

    Two things...


    1 - FreeNAS 9.2 is using samba 4.1.4. OMV 1.0 is using samba 3.6.6 and 0.5 is using 3.6.3. Apple owns samba so maybe OS X works better with samba4 now??


    2 - I can easily saturate gigabit with OMV 0.5 and 1.0 on my systems (including an N40L) with Windows and Linux clients. Have you tried a Windows or Linux box?


    Edit - one more thing... Try the backports kernel.

    omv 7.0.4-2 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.10 | compose 7.1.2 | k8s 7.0-6 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • On both OMV there are the backport kernels installed


    I have also samba in my focus .... was hoping there is a decent version of samba in OMV 1.x/debian7.


    What about afp? This is one of the reasons i like to abandon my freenas boxes, they are too far behind.


    Any chances to get the current versions of samba or afp on OMV?



    And no, dont have any (non virtual) windows box here. Lots of linux servers but all are on esxi hosts. I assume it is samba, iperf shows same performance with full saturation for FN & OMV...

    Tom


    ----


    HP N54L, 6GB, 5disc Raid5, SSD Boot with OMV 5
    HP N54L, 16GB, 4disc ZFS pool, SSD Boot with other NAS system

    • Offizieller Beitrag

    Decent version?? Samba 3.6.6 works great and is ultra stable which is what Debian stands for.


    afp should work ok but I see Apple moving to samba.


    OMV uses whatever version of samba and afp that Debian Wheezy uses for the stable package.


    Try adding the following to the extra options box in the smb settings tab and retest:
    max protocol = SMB2

    omv 7.0.4-2 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.10 | compose 7.1.2 | k8s 7.0-6 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • Yeah its def. sambas fault, tested with afp again and this time it looks good:


    Results 81.22
    System Info
    Xbench Version 1.3
    System Version 10.9.4 (13E28)
    Physical RAM 16384 MB
    Model MacBookPro11,3
    Disk Test 81.22
    Sequential 48.41
    Uncached Write 23.73 14.57 MB/sec [4K blocks]
    Uncached Write 164.27 92.94 MB/sec [256K blocks]
    Uncached Read 34.55 10.11 MB/sec [4K blocks]
    Uncached Read 183.34 92.14 MB/sec [256K blocks]
    Random 252.12
    Uncached Write 129.83 13.74 MB/sec [4K blocks]
    Uncached Write 289.57 92.70 MB/sec [256K blocks]
    Uncached Read 370.97 2.63 MB/sec [4K blocks]
    Uncached Read 496.60 92.15 MB/sec [256K blocks]



    Blackmagic:


    Write: 110MB/s, Read 111/MB/s

    Tom


    ----


    HP N54L, 6GB, 5disc Raid5, SSD Boot with OMV 5
    HP N54L, 16GB, 4disc ZFS pool, SSD Boot with other NAS system

  • On FNas i have min protocol = SMB2!!! OSX uses v 2 & v3 afaik.


    The main problem is that it seems to bring problems when you share the same folder with samba AND afp. Thats why i try to avoid afp now (there are sometimes guests & coworkers here with windows machines, so we need smb. also for mounting from linux)


    So the AFP only solution is not ideal

    Tom


    ----


    HP N54L, 6GB, 5disc Raid5, SSD Boot with OMV 5
    HP N54L, 16GB, 4disc ZFS pool, SSD Boot with other NAS system

  • AHHH, limiting smb to prot 2 helps a lot:


    Results 64.52
    System Info
    Xbench Version 1.3
    System Version 10.9.4 (13E28)
    Physical RAM 16384 MB
    Model MacBookPro11,3
    Disk Test 64.52
    Sequential 37.29
    Uncached Write 16.59 10.18 MB/sec [4K blocks]
    Uncached Write 170.76 96.61 MB/sec [256K blocks]
    Uncached Read 28.12 8.23 MB/sec [4K blocks]
    Uncached Read 179.59 90.26 MB/sec [256K blocks]
    Random 239.44
    Uncached Write 95.39 10.10 MB/sec [4K blocks]
    Uncached Write 303.32 97.10 MB/sec [256K blocks]
    Uncached Read 1148.16 8.14 MB/sec [4K blocks]
    Uncached Read 486.76 90.32 MB/sec [256K blocks]



    Blackmagic: Write 104MB/s, Read 93MB/s

    Tom


    ----


    HP N54L, 6GB, 5disc Raid5, SSD Boot with OMV 5
    HP N54L, 16GB, 4disc ZFS pool, SSD Boot with other NAS system

  • Did test the same on FNas again with samba limited to V2. Here the results are still the same then with V3. So it seems the older samba version doesnt perform good on V3 proto.


    FNAs 7.2.14 w. SMB2 min/max:


    Results 76.99
    System Info
    Xbench Version 1.3
    System Version 10.9.4 (13E28)
    Physical RAM 16384 MB
    Model MacBookPro11,3
    Disk Test 76.99
    Sequential 45.85
    Uncached Write 20.29 12.46 MB/sec [4K blocks]
    Uncached Write 154.45 87.39 MB/sec [256K blocks]
    Uncached Read 39.42 11.54 MB/sec [4K blocks]
    Uncached Read 163.50 82.18 MB/sec [256K blocks]
    Random 239.93
    Uncached Write 98.30 10.41 MB/sec [4K blocks]
    Uncached Write 279.38 89.44 MB/sec [256K blocks]
    Uncached Read 1594.95 11.30 MB/sec [4K blocks]
    Uncached Read 436.18 80.94 MB/sec [256K blocks]


    Blackmagic: Write 109MB/s, Read 103MB/s


    Still some advantage on 4k blocks, but worse on 256k blocks. I think its usable like this :)



    @Mods: maybe it makes sense to move this threas to SMB

    Tom


    ----


    HP N54L, 6GB, 5disc Raid5, SSD Boot with OMV 5
    HP N54L, 16GB, 4disc ZFS pool, SSD Boot with other NAS system

    Einmal editiert, zuletzt von tom_tav ()

  • FYI, benching with scp is allways limited due to the encryption.


    Greetings
    David

    "Well... lately this forum has become support for everything except omv" [...] "And is like someone is banning Google from their browsers"


    Only two things are infinite, the universe and human stupidity, and I'm not sure about the former.

    Upload Logfile via WebGUI/CLI
    #openmediavault on freenode IRC | German & English | GMT+1
    Absolutely no Support via PM!

    • Offizieller Beitrag

    Moved.


    Glad to hear it is working better :)

    omv 7.0.4-2 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.10 | compose 7.1.2 | k8s 7.0-6 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

Jetzt mitmachen!

Sie haben noch kein Benutzerkonto auf unserer Seite? Registrieren Sie sich kostenlos und nehmen Sie an unserer Community teil!