Author Topic: Upgrading to Snology DS1517+ (8GB RAM model) with 10GbE networking?  (Read 9242 times)

2018-01-28, 23:21:57

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile

What I have so far is the DS918+ and Zenith Extreme Motherboard which came packaged with a 10GbE card (RJ45) and the ASUS DSL-AC68U modem/router.


To get 10GbE, I might just have to sell the DS918+ and opt for the DS1517+ 8GB model (found here on senetic)


I'm just setup on one workstation currently and was hoping to delve into the land of fast 10GbE.


I unknowingly didn't really know the benefits of having a 10GbE before I bought the DS918+.
The reason for the NAS is just to have one accessible place to grab work files from anywhere when I need too and store all my other personal files. But having the luxury to edit directly from the NAS would be great.


Q's.
  • What do I need for 10GbE connection directly to the NAS apart from the 10GbE network interface for the NAS to connect to my PC which has the RJ45 10gbe card? My router is the dsl-ac68u (1900 mbps).
  • Will the router do? Or does that need upgrading too?
  • Is there another way to skin this cat?
Any expertise on this subject would be great, thanks.

2018-01-29, 05:19:42
Reply #1

SaY

  • Active Users
  • **
  • Posts: 72
    • View Profile
You would need a switch.
Luckily the prices came down a lot lately, here is an affordable 5-port 10gb:
https://www.ebay.com/sch/i.html?_from=R40&_trksid=p2047675.m570.l1313.TR0.TRC0.H0.XNetgear+XS505M-100NAS+.TRS5&_nkw=Netgear+XS505M-100NAS+&_sacat=0
I'm running a Freenas server on 10gb network in my studio and getting consistent 700-800MB/s network read/write speed.  Faster than any sata SSD drive.

2018-01-29, 12:44:16
Reply #2

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile


Thanks, I've found this card for the NAS:

€100 for a Dell Intel Single Port Copper RJ-45 10Gb PCI-e x8 Network Low Profile NIC
https://www.ebay.ie/itm/NEW-Dell-Intel-Single-Port-Copper-RJ-45-10Gb-PCI-e-x8-Network-Low-Profile-NIC/391741715588?ssPageName=STRK%3AMEBIDX%3AIT&_trksid=p2055119.m1438.l2649


Then someone on amazon answered my Q with this switch which is 2 port:

€287.95 for the ASUS XG-U2008 Unmanaged 2-Port 10G/8-Port Gigabit Switch
https://www.amazon.co.uk/ASUS-XG-U2008-Unmanaged-2-Port-Gigabit/dp/B01NCT21GL/ref=sr_1_1?ie=UTF8&qid=1517225508&sr=8-1&keywords=asus+xg-u2008

  • Would these do the trick?
  • Is the low profile cards the only ones that work in a NAS?
  • Would I need a two 10G port for the NAS for any reason?
  • Will the RJ45 cables that come with the NAS CAT5e work?
« Last Edit: 2018-01-29, 14:31:59 by 3dwannab »

2018-01-29, 16:53:04
Reply #3

Juraj

  • Moderator
  • Active Users
  • ***
  • Posts: 4761
    • View Profile
    • studio website
While all the network cards are made by either Intel or Aquantia I would rather buy one directly from Intel than the Dell branded ones. They cost the same on ebay, or just tiny bit difference.

https://www.synology.com/en-global/compatibility?search_by=products&model=DS1517%2B&category=network_interface_cards&p=1

Make sure you buy one with RJ45 lan port, not the SFP+ ones.

The Asus is good enough as long as you only need two 10 10gbit ports (one will got to the NAS, one to your workstation, other devises will connect at 1gbit).

CAT5e is good enough for 10gbit up to 50 +/- meters.
Please follow my new Instagram for latest projects, tips&tricks, short video tutorials and free models
Behance  Probably best updated portfolio of my work
lysfaere.com Please check the new stuff!

2018-01-29, 18:08:10
Reply #4

SaY

  • Active Users
  • **
  • Posts: 72
    • View Profile


Thanks, I've found this card for the NAS:

€100 for a Dell Intel Single Port Copper RJ-45 10Gb PCI-e x8 Network Low Profile NIC
https://www.ebay.ie/itm/NEW-Dell-Intel-Single-Port-Copper-RJ-45-10Gb-PCI-e-x8-Network-Low-Profile-NIC/391741715588?ssPageName=STRK%3AMEBIDX%3AIT&_trksid=p2055119.m1438.l2649


Then someone on amazon answered my Q with this switch which is 2 port:

€287.95 for the ASUS XG-U2008 Unmanaged 2-Port 10G/8-Port Gigabit Switch
https://www.amazon.co.uk/ASUS-XG-U2008-Unmanaged-2-Port-Gigabit/dp/B01NCT21GL/ref=sr_1_1?ie=UTF8&qid=1517225508&sr=8-1&keywords=asus+xg-u2008

  • Would these do the trick?
  • Is the low profile cards the only ones that work in a NAS?
  • Would I need a two 10G port for the NAS for any reason?
  • Will the RJ45 cables that come with the NAS CAT5e work?

1,2) I would check with Synology if the adapter will work. As i understand you already have 10gb for your workstation.  Of course Synology will try to sell their branded adapters for 3x the price but Juraj is right - all adapters pretty much the same. Check the synology forum to see what adapters are tested by the users.
3) 1 is enough.
4) Cat 5e will work if they not too long. Or just get Cat7 on amazon, prices are not that high.

That switch you found will work great if you're sure you will have only one 10gb workstation.  All the nodes will get 1gb which is enough to transfer scenes and assets.

2018-01-29, 18:26:09
Reply #5

Juraj

  • Moderator
  • Active Users
  • ***
  • Posts: 4761
    • View Profile
    • studio website
The newer TIA approved successor is actually CAT6A, which I would suggest because it's compatible with every 10gbit device, unlike Cat7 whose GigaGate45 (GG45) connectors might cause some backwards compatibility issues.

Please follow my new Instagram for latest projects, tips&tricks, short video tutorials and free models
Behance  Probably best updated portfolio of my work
lysfaere.com Please check the new stuff!

2018-01-30, 18:50:21
Reply #6

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile
Thanks for the good answers guys.


Sorry for the late reply but I've having outrageous trouble backing up to an external drive connected via USB3.0 using the so called Hyper Backup app of Snologys with version history (Long thread about it here). So far, 4TB has taken 4 days. Still at 92%. I’m also gone 92% crazy with it! Renaming the app to ‘Sammy the slug Backup’ would be more apt.


But, I digress.
I’m just not sure if the NAS running in Snologys proprietary RAID SHR would take advantage of 10GbE.


So, what about 40Gbps.


Would I be safer getting a 4 Bay QNAP-TS-453BT3-8G below with DUAL Thunderbolt 3 ports for €1,200 and setting up a different RAID type. I went ahead and got the Ironwoft 10TB drive so I could have one drive and 3 as redunancy. I'm sure the W/R speeds would be crazy.
https://www.amazon.co.uk/QNAP-TS-453BT3-8G-Bay-Desktop-Enclosure/dp/B076ZXZ2SF/ref=sr_1_1?s=computers&ie=UTF8&qid=1517333438&sr=1-1&keywords=QNAP+TS-453BT3
and get a TB3 expansion card for the PC like the ASUS ThunderboltEX 3 for €75
https://www.amazon.com/ASUS-Expansion-Card-Motherboards-ThunderboltEX/dp/B01HDUVJ54


The above price would be similar to what I’ve fork out for the other setup. PLUS, I could flog my 10GbE ASUS card. And have a daisy chainable system.
 
« Last Edit: 2018-01-30, 18:57:50 by 3dwannab »

2018-01-30, 19:55:53
Reply #7

Juraj

  • Moderator
  • Active Users
  • ***
  • Posts: 4761
    • View Profile
    • studio website
Don't get me started on the HyperBackup. I tried it when I first bought my first Synology NAS and I was literally shocked how sluggish it is.

I now back-up using (paid) SyncBreeze which can be configured from super-simple to ultra-complex. It is incredibly fast. Like billion times faster I am not kidding.
It's able to search my 4TB SSD drives full of projects and assets within like 2 minutes. Then back-up using 100perc. of the speed of drive.

Thunderbolt NAS are waste unless you connect them directly to your Workstation, in which case you might as well install those drives locally on your workstation.

The moment you want fast, large capacity and expandable to 10gbe NAS, it gets so expensive it's actually cheaper to build a regular PC as file-server.
If full-on file-server is too complex, one can still install some linux-distro like FreeNas on it instead of Windows, but I run Windows on it instead.
Please follow my new Instagram for latest projects, tips&tricks, short video tutorials and free models
Behance  Probably best updated portfolio of my work
lysfaere.com Please check the new stuff!

2018-01-30, 20:07:18
Reply #8

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile
It's brutal. The bad type of brutal.


The Irish meaning of the word is quite different to other countries. :)


So that SyncBreeze is an app available in DSM? I've had to step away from the PC in case I break something up. ;)


I will be connecting directly to my workstation. AFAIK thunderbolt is daisychannable so if I attach a laptop to a hub or to the spare TB 3 I/O in the QNAP it'll be very handy.


That qnap also has a ready installed 10G NIC. So it has options.


Would RAID 10 be the choice for the fastest read/writes? I've 4 x 10tb hard drives so 3 can be redundant.

2018-01-31, 10:32:39
Reply #9

Juraj

  • Moderator
  • Active Users
  • ***
  • Posts: 4761
    • View Profile
    • studio website
I am not sure if the QNAP card isn't SFP+ only, better check it.

If you don't plan the NAS for office of multiple PCs, then the thunderbolt is ok then.
Please follow my new Instagram for latest projects, tips&tricks, short video tutorials and free models
Behance  Probably best updated portfolio of my work
lysfaere.com Please check the new stuff!

2018-01-31, 19:10:04
Reply #10

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile
With thunderbolt and the right raid config would it be better than a 10G setup.


I might just ask the approx speed on the forum.

2018-02-01, 20:38:40
Reply #11

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile
I've thought about it and decided to scrap the idea of 10GbE for now as I've only one workstation and the benifits far outway the cost.


So, I've got an existing 1TB 960Pro here (need 2TB) so might just get another and put them in RAID 0 and be done with it. Which will blow any other type setup out of the water.
And, use that as a work drive along with windows backup with file versioning enabled to do 15-min interval backups to the 1GbE connection to the NAS. And weekly backups to the external offsite device.


Doing those frequent backups won't bare the system down too much.


I just got to look at the performance gain for NVMe in RAID 0. But it'll far outway anything a 10GbE could do.

2018-02-18, 22:19:42
Reply #12

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile
CDM Results for 2x 960pros in RAID 0. 1.9TB.

:)                                                 :)                                                 :)                                                 :)                                                 :)                                                 :)                                                 :)                                                 :)

2018-02-20, 01:36:57
Reply #13

Juraj

  • Moderator
  • Active Users
  • ***
  • Posts: 4761
    • View Profile
    • studio website
Are you showing off :- ) ? (your insanity)
Please follow my new Instagram for latest projects, tips&tricks, short video tutorials and free models
Behance  Probably best updated portfolio of my work
lysfaere.com Please check the new stuff!

2018-02-20, 01:55:33
Reply #14

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile
I never have to try hard at that I'm afraid.


Using this as the primary drive backing up on the regular is a good solution for me.


What's sort of W/R speeds do you get with your 10g setup?

2018-02-20, 17:14:17
Reply #15

Juraj

  • Moderator
  • Active Users
  • ***
  • Posts: 4761
    • View Profile
    • studio website
My network drives are PCI-E Intel P3600 2TB each, so the 10gbit does actually bottleneck them in continual write/read speeds :- ) but I barely ever do that. It caps at 1200 MB/s +/-.
Please follow my new Instagram for latest projects, tips&tricks, short video tutorials and free models
Behance  Probably best updated portfolio of my work
lysfaere.com Please check the new stuff!

2018-02-20, 17:32:22
Reply #16

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile
That's still good :)
Having these in these setup it's the CPU and RAM freq. that's the bottleneck. With overclocking to 4GHz you can get past 7GB/Sec read but similar writes.


My setup with this test was using stock threadripper 1950x [not overclocked, yet but will do eventually] and 128GB RAM @ 2,800MHz.

2018-02-24, 15:01:31
Reply #17

Rhodesy

  • Active Users
  • **
  • Posts: 553
    • View Profile
Just hijacking this thread! I'm thinking about getting the DS1817+ with a 10gb card and 8 port 10gb unmanaged switch. I have recently bought 4x4gb iron wolf dives for my existing nas which is purely a back up drive with versioning. I thought I'd be able to use those drives and get 4 more of the same and run a raid 10 setup with 2 disk redundancy. But I have just checked them and they are only the 5900rpm flavour not 7200. Do you think this will make a big difference in that raid 10 setup for seak times which is important for tracking all those textures down? I would rather bite the bullet and buy some new larger capacity faster drives if it is going to make the difference but it's probably going to cost a good £600+ to do that on top of everything else. So don't want to do that if it's a waste.

Also am I likely to see speeds that are faster than my middle of the road ssd with this setup?

Finally do you know if it's possible to make a drive letter on the nas so it looks exactly like a local drive? I've got many materials all over the shop which have direct paths set to my texture ssd and it would be a nightmare to lose all those?

Thanks for any help.

2018-02-24, 15:56:36
Reply #18

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile

I've ended up getting a 10g switch anyway in conjunction with 2 nvmes in raid0.

I installed the 4 drives into the new one using snologys online tut on it no problem. Took half an hour.

Then installed the extra drive. So far it's taken 6 days to do 70% on a volume parity consistency. So, I've not been able to install the 10g setup. I was getting 120mb on the old 1g setup.

As far as searching files. Windows is slow compared to using freecommder explorer SW even when you uncheck search file contents. I bought the donor version of freecommder which is x64 and very good.

You cannot index a NAS like your internal drives. I've seen workarounds but yet to try them out.

Yes, mapping the drive is the same as usual. Assign Z as this is the most common server/NAS drive letter. Up to you though.

Will post back when I get the WR speeds and what searching is like when this parity finishes. (pulls out hair)


2018-02-25, 09:49:31
Reply #19

Rhodesy

  • Active Users
  • **
  • Posts: 553
    • View Profile
Thanks for the info and looking forward to your update. Will look in to free commander.

2018-02-25, 19:30:05
Reply #20

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile
Parity checking FINALLY stopped so I could install the 10GbE (simple) setup with the DS1517+. I just installed the 10G NIC with the small bracket in the 1517+, installed the RJ45 10GbE NIC that came with my Zenith Extreme motherboard and used the ASUS switch mentioned in above posts. (RJ45 type)

Here's the WR speeds comparison between my new NAS speeds and an SSD. Lastest drivers might bump speeds up a bit. (I dunno).
(My old 1GbE setup was 120 Write and around 80 read in Seq.)
https://imgur.com/a/Ia2z0
This new setup is roughly 5.5 times better performance than the old also. Not exactly 10 times but I'm sure that's because I'm running SHR RAID. I've more testing to do.

Took about a minute in FreeCommander to finish searching a folder for one filename around 1minute.

Folder was quite large @ 455GB, 19105 folders & 102219 files.

Hope this info helps.

2018-02-26, 11:18:29
Reply #21

Juraj

  • Moderator
  • Active Users
  • ***
  • Posts: 4761
    • View Profile
    • studio website
Btw, a bunch of Asus XG C100C 10gbit cards arrived at my office :- ). Really nice, single-port, passively cooled and you can get them for 90 euros each. Imho better than the Intel card, let's see if drivers are fine.
Please follow my new Instagram for latest projects, tips&tricks, short video tutorials and free models
Behance  Probably best updated portfolio of my work
lysfaere.com Please check the new stuff!

2018-02-26, 15:39:15
Reply #22

Rhodesy

  • Active Users
  • **
  • Posts: 553
    • View Profile
They must be the same as the one packaged with the Zenith mobo. Yes great to have the option of a cheaper single socket card. Its more expensive in the UK of course!

Thanks for the update 3Dwannab. You have done well to get 5.5X performance. Most of the other reviews I have read give about a 3-4 X performance over 1GB speeds but thinking about it that was just with standard NAS drives. Im confused I thouight you had to chose either the 10GB card or PCI based SSD in that unit as there was only one slot?

2018-02-26, 16:34:27
Reply #23

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile

They must be the same as the one packaged with the Zenith mobo. Yes great to have the option of a cheaper single socket card. Its more expensive in the UK of course!

Thanks for the update 3Dwannab. You have done well to get 5.5X performance. Most of the other reviews I have read give about a 3-4 X performance over 1GB speeds but thinking about it that was just with standard NAS drives. Im confused I thouight you had to chose either the 10GB card or PCI based SSD in that unit as there was only one slot?

Yeah, they prob slapped the outer casing on mine and rebranded it.

No, my workflow is two nvmes in RAID0 (2TB), which backs to the NAS every so often, then external offsite every weekend. I went ahead and got the 10g setup anyway.

Why the hell not, I like blowing my money away ;)


Btw, a bunch of Asus XG C100C 10gbit cards arrived at my office :- ). Really nice, single-port, passively cooled and you can get them for 90 euros each. Imho better than the Intel card, let's see if drivers are fine.

Same as the one I have only rebranded like I said probably. Let me know your performance please.

2018-03-01, 17:45:12
Reply #24

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile
10Gbe UPDATE:

I was getting these results in CDM below.



But in transferring files, I was only getting 80MB/s. Not sure what I did to get this but I swapped the LAN port on the back of the i10Gb X540-T2 and get results that were closer to the CDM results.
I thought that the two ports on that were 10GbE. Or else the top one of the two is faulty.

I'm getting real file transfer speeds (when copying a 16GB file)

NAS & HD SSD:
500MB/s from NAS to HD SSD
350MB/s from HD SSD to NAS.

NVMe SSD (960 PRO) & NAS:
430MB/s from NAS to NVMe SSD
350MB/s from NVMe SSD to NAS

What stumps me is the transfers are better to the HD SSD. The NVMe is a little bit worse. I wonder what the bottleneck would be.

2018-03-06, 01:56:50
Reply #25

3dwannab

  • Active Users
  • **
  • Posts: 362
    • View Profile
I have to say I've completely overlooked a CMD command called robocopy for my backup procedure!!

It's quite amazing.

I've created a W Drive Backup.cmd file (W Drive Backup can be any filename you like) and wrote up this little beaut. One click and it runs the copy with options via the switches. I just need to find a program that can run this every hour or so.

Just don't name the file robocopy.cmd or you're in for a world of pain resulting in a continous loop of the .cmd file.

For the schedule, windows built-in 'Task Scheduler' will probably do the trick to start it upon login and the /MON:n AND /MOT:m switches will monitor changes and by time. Please refer to code for these two switches.

Code: [Select]
REM title Backing Up Made Easy. [%~nx0] by 3dwannab
@ECHO off

SET SOR_PATH1=W:
SET DES_PATH1=Z:\Backups\Drive W Backup
Start /Min "JOB: %DES_PATH1% Job" robocopy "%SOR_PATH1%" "%DES_PATH1%" /MON:50 /MOT:30 /XO /MIR /FFT /Z /XA:H /R:10 /W:10 /MT:5 /XD "$RECYCLE.BIN" "System Volume Information" /XF "thumbs.db"
attrib -s -a -h "%DES_PATH1%"

::::::::::::::::::::::::::::::::::::::::

SET SOR_PATH2=C:
SET DES_PATH2=Z:\Backups\Drive C Backup
Start /Min "JOB: %DES_PATH2% Job" robocopy "%SOR_PATH2%" "%DES_PATH2%" /MON:50 /MOT:60 /XO /MIR /FFT /Z /XA:H /R:10 /W:10 /MT:5 /XD "$RECYCLE.BIN" "System Volume Information" "*Windows*" "*microsoft*" "*dropbox*" "nvidia" "temp" "C:\Windows" "C:\ffmpeg" "C:\PerfLogs" "C:\Python34" "C:\Swsetup" "C:\temp" /XF "C:\*" "thumbs.db" "*.thumb" "*.bak" "*.sv$"
attrib -s -a -h "%DES_PATH2%"

REM @pause

:: More Info here:
:: https://social.technet.microsoft.com/wiki/contents/articles/1073.robocopy-and-a-few-examples.aspx
:: https://ss64.com/nt/robocopy.html

:: NOTES
:: ---------------------------------
:: start /min runs robocopy in minimised mode.
:: /MT[:n] where n = no. of threads being used.
:: /MIR specifies that Robocopy should mirror the source directory and the destination directory. Note that this will delete files at the destination if they were deleted at the source.
:: /FFT uses fat file timing instead of NTFS. This means the granularity is a bit less precise. For across-network share operations this seems to be much more reliable - just don't rely on the file timings to be completely precise to the second.
:: /Z ensures Robocopy can resume the transfer of a large file in mid-file instead of restarting.
:: /XA:H makes Robocopy ignore hidden files, usually these will be system files that we're not interested in.
:: /R:<n> Specifies the number of retries on failed copies. The default value of n is 1,000,000 (one million retries max).
:: /W:<n> Specifies the wait time between retries, in seconds. The default value of n is 30 (wait time 30 seconds).
:: /MON:n : MONitor source; run again when more than n changes seen.
:: /MOT:m : MOnitor source; run again in m minutes Time, if changed.

:: EXAMPLES
:: ---------------------------------
:: #8 Mirror directory excl. deletion
:: To mirror the directory "C:\directory" to "\\server2\directory" excluding \\server2\directory\dir2" from being deleted (since it isn't present in C:\directory) use the following command:

:: Robocopy "C:\Folder" "\\Machine2\Folder" /MIR /XD  \\server2\ directory\dir2"
:: Robocopy can be setup as a simply Scheduled Task that runs daily, hourly, weekly etc. Note that Robocopy also contains a switch that will make Robocopy monitor the source for changes and invoke synchronization each time a configurable number of changes has been made. This may work in your scenario, but be aware that Robocopy will not just copy the changes, it will scan the complete directory structure just like a normal mirroring procedure. If there are a lot of files & directories, this may hamper performance.

Basic explanation of code shown after :: in code above with resource links.
This will back up my W Drive (Work Folder) and C Drive with a few omissions as you can see.
The only thing I'll change after the initial backup is the thread count of the copies to maybe 6 so it's less in your face when running every hour.

If you want to autoclose the CMD delete the @pause or block it by adding :: to it like so ::@pause
« Last Edit: 2018-03-07, 20:59:30 by 3dwannab »