Distributed Encoding?

[m00511]

Hi again , my last Thread was about GPU or CPU Encoding that I found the GPU has a Higher speed with a lower quality in low bitrate so Because i care about the final quality and the final size is important for me i am encoding my videos with crf 23 - 25 in both x264 and x265 but i need speed too i can not spend too much time for encoding my videos and i need to be faster - when i searched about fast encoding i found GPU but it is not good in quality ,yesterday i found distributed encoding with some software (that did not work for me) - i have 2 or 3 dedicated server for encoding and i can not use the both for encoding 1 video in the same time , please guide me and show me how can i do that - if you guys have another way to encode with higher fps please tell me

thank u guys

[Selur]

Probably not really helpful, but:

What speeds are you aiming for? What hardware and infrastructure do you use? What OS are you using?

if you guys have another way to encode with higher fps please tell me

how about the obvious: faster CPU(s) with more CPU cores for encoding and gpu for decoding

Personally for me distributed encoding isn't that interesting, since:

• it usually happens by splitting the source into multiple parts, encode each part and then join those parts together.
  This isn't a bad idea in itself, but I have yet to see a tool which looks for good partitioning of the source and not simply a. uses a fixed number of frame without taking scene changes and the encoder that is used into account b. just chunks at the key frames of the source
• I stopped hording machines years ago and nowadays I have one main machine and a few slow machines I use for other task (file server, backup server, router). So even if a better solution than the ones currently available would present itself I probably wouldn't look into it.
• I get 24-30fps when using:
  

  ffmpeg -y -loglevel fatal -hwaccel dxva2 -threads 1 -r 24000/1001 -analyzeduration 200M -probesize 200M -i "00005.m2ts" -map 0:0 -an -sn  -vsync 0 -pix_fmt yuv420p  -f rawvideo - | x264 --preset slower --crf 18.00 --profile high --level 4.1 --ref 4 --vbv-maxrate 62500 --vbv-bufsize 78125 --sar 1:1 --non-deterministic --range tv --colormatrix bt709 --demuxer raw --input-res 1920x1080 --input-csp i420 --input-depth 8 --fps 24000/1001 --output-depth 8 --output "H:\Temp\10_27_09_8510_01.264" -

  which is fast enough for my usual needs

-> for folks to give you advice you probably might want to share details about what you tried (in details), what you aim for.

Cu Selur

Ps.:

distributed encoding with some software (that did not work for me)

In case it's RipBot264 -> ask in the RipBot264 thread for help to get it running.

[m00511]

What speeds are you aiming for? What hardware and infrastructure do you use? What OS are you using?

my Encoding Setting is x264 default (medium) preset and my cpu is i7-6600 with 16 GB ram and i get 25 - 30 fps for 1080p

-> for folks to give you advice you probably might want to share details about what you tried (in details), what you aim for.

Actully i have too much encoding and sometime i have too encode several videos in the same time and it is obviuos the fps will be lower

i am searching a lot for a solution and until now i didnt found anything

[Selur]

my Encoding Setting is x264 default (medium) preset and my cpu is i7-6600 with 16 GB ram and i get 25 - 30 fps for 1080p

Okay, using medium preset:

ffmpeg -y -loglevel fatal -hwaccel dxva2 -threads 1 -r 24000/1001 -analyzeduration 200M -probesize 200M -i "00005.m2ts" -map 0:0 -an -sn  -vsync 0 -pix_fmt yuv420p  -f rawvideo - | x264 --profile high --level 4.1 --vbv-maxrate 62500 --vbv-bufsize 78125 --sar 1:1 --non-deterministic --range tv --colormatrix bt709 --demuxer raw --input-res 1920x1080 --input-csp i420 --input-depth 8 --fps 24000/1001 --output-depth 8 --output "H:\Temp\10_27_09_8510_01.264" -

I get 50+ fps on a Ryzen X18000.

Actully i have too much encoding and sometime i have too encode several videos in the same time and it is obvious the fps will be lower

Okay, when you have multiple files, why not simply encode each file on a separate machine?
I don't think there is a software which offers a simple gui to control multiple clients so each encodes a separate file atm.

[m00511]

I get 50+ fps on a Ryzen X18000.

I do not know much about the brands (AMD - Intel) and chpistes - AMD Ryzen 7 1700X is better or

Ryzen X18000

or i7-6700 Quad-Core Skylake????

Okay, when you have multiple files, why not simply encode each file on a separate machine?

Because i downloading and encoding is automatic and i can not do that - so i have to encode each file on separate machine so help me with the chipsets - i have i7-6700 3.40 GHz

Thank You su much for helping a noob such me

[Selur]

Sorry, typo "AMD Ryzen 1800X"