How to use ffmpeg to encode files from folder1 to folder2

[JN-]

How to use ffmpeg to encode files from folder1 to folder2 keeping output files in same output folder structure.

I couldn't fit all of above into Title:

Despite valiant efforts I have come up empty. The files are always saved to the output folders root, not into the output folders subfolders similar to the source subfolders layout.

There may be a completely different and better way than the 2 trys below, hopefully.

I hope someone can help with this. Thanks.

The XTREE command initially creates the correct empty folder structure in the output folder.

The ffmpeg command syntax is an arbitrary scaling, but can be anything else.

I am including here my own effort ("Version-2.bat") and one posted on inet ("reconvert.bat") but both fail.

Reconvert ...
REM -----------------------------------------------------------------------------

REM user dirkgently on stackoverflow. https://stackoverflow.com/users/66692/dirkgently
REM https://mostlybuggy.wordpress.com/2012/09/25/windows-batch-file-how-to-copy-and-conver...y-with-ffmpeg/

@echo off
mode CON:cols=228 lines=30
color 0A
SETLOCAL EnableDelayedExpansion

REM keep a counter for files converted
set /A nfile=0
REM do not copy empty folders or any files
@echo Copying directory structure from %0 to %1 ...
xcopy /T %1 %2
REM walk directory structure and convert each file in quiet mode
for /R %1 %%v in (*.mp4, *.aac, *.flv, *.m4a, *.mp3) do (
echo converting "%%~nxv" ...
ffmpeg -v quiet -i "%%v" "%2\%%~nv.mp3"
set /A nfile+=1
)
echo Done! Converted %nfile% file(s)

REM To use it simply fire up a command prompt and type in:

REM rconvert G:\Music Z:\Fun\

REM Note that the trailing ‘\’ is necessary to indicate that Fun is a directory and not a file.

REM PS: I threw in a counter too just so you know how many files you’ve copied

pause
exit
REM -----------------------------------------------------------------------------

REM My try ... Version-2
REM -----------------------------------------------------------------------------

@echo off
SETLOCAL EnableDelayedExpansion

MD #02-Output
XCOPY /T /E ".\#01-Source\" ".\#02-Output\"

FOR /R ".\#01-Source\" %%G in (*.mov, *.mp4, *.mp3) do (
ffmpeg -y -i "%%G" -c:v h264_nvenc -pix_fmt yuv420p -cq 23 -vf scale=-2:1080 -bf:v 0 -b:v 0 -maxrate 100 -g 25 -c:a copy ".\#02-Output\%%~nxG"
)

REM pause
exit

[JN-]

Two batch files used.

[krykmoon]

The problem in your batch file is that in:

 ".\#02-Output\%%~nxG"

%%~nxG

returns only the FILENAME (and the extension) without any path, so every file processed is stored in "\#02-Output\".

[JN-]

Yes, I suspected that was the issue, thanks for confirming.

Any idea on how to overcome "?

I’ll try just removing .\#02-Output\ and see, thought I think that I had already done that. ill be back.

[JN-]

This obviously doesn't work either. Version-2.bat

MD #02-Output
XCOPY /T /E ".\#01-Source\" ".\#02-Output\"

FOR /R ".\#01-Source\" %%G in (*.mov, *.mp4, *.mp3) do (
REM ffmpeg -y -i "%%G" -c:v h264_nvenc -pix_fmt yuv420p -cq 23 -vf scale=-2:1080 -bf:v 0 -b:v 0 -maxrate 100 -g 25 -c:a copy ".\#02-Output\%%~nxG"
ffmpeg -y -i "%%G" -c:v h264_nvenc -pix_fmt yuv420p -cq 23 -vf scale=-2:1080 -bf:v 0 -b:v 0 -maxrate 100 -g 25 -c:a copy "%%~nxG"
)


I need to give output the full subdirectories paths ?

[krykmoon]

This has been VERY difficult, I had to think a lot and then to study a lot that damn BATCH mess.. and, finally, to experiment a lot. I was very close to give up more than one time.

It's a sort of trick and workaround, playing with all that messy stuff in CMD .. but.. I think it should work.

You need to put the batch file in a folder with an IN Folder with all the files to process (even with subfolders).

 @echo off
SETLOCAL EnableDelayedExpansion

REM Name of the Folder with Files to be processed
SET inputdir=IN

REM Name of the Folder where the Output should go
SET outputdir=OUT

MD "%outputdir%"
XCOPY /T /E "%inputdir%" "%outputdir%"

FOR /R "%inputdir%" %%G in (*.mov, *.mp4, *.mp3) do ( call :Parse %%G )
pause
exit

:Parse
set input=%*
set cut=%~dp0
set cut=%cut%%inputdir%
call set output=%%input:%cut%=%%
set fulloutput=%outputdir%%output%
ffmpeg -y -i "%input%" -c:v h264_nvenc -pix_fmt yuv420p -cq 23 -vf scale=-2:1080 -bf:v 0 -b:v 0 -maxrate 100 -g 25 -c:a copy "%fulloutput%"
)

[JN-]

AOK. Thanks for all of that. I'll give it a try and get back.

I spent most of yesterday and up to past 3 in the morning without a solution. So I appreciate that it's difficult.

[krykmoon]

AOK. Thanks for all of that. I'll give it a try and get back.

I spent most of yesterday and up to past 3 in the morning without a solution. So I appreciate that it's difficult.

Let me know if it works. No AI, only HHT (*) here


(*) Heavy Human Thinking

[JN-]

OK. No joy yet.

I created a folder named "IN" only and put files in root of "IN" plus subfolders with files in them also. So a proper subfolder structure with a few files.

Running script it produced an output folder "OUT" with correct subfolder structure but only processed a single file into the root of OUT folder.

There is an mp3 + mov file in the root. It's as if the script stopped after the 1st. file being processed ?


@echo off
mode CON:cols=228 lines=60
color 0A
SETLOCAL EnableDelayedExpansion


REM Name of the Folder with Files to be processed
SET inputdir=IN

REM Name of the Folder where the Output should go
SET outputdir=OUT

MD "%outputdir%"
XCOPY /T /E "%inputdir%" "%outputdir%"

FOR /R "%inputdir%" %%G in (*.mov, *.mp4, *.mp3) do ( call :Parse %%G )
REM pause
REM exit

:Parse
set input=%*
set cut=%~dp0
set cut=%cut%%inputdir%
call set output=%%input:%cut%=%%
set fulloutput=%outputdir%%output%
ffmpeg -y -i "%input%" -c:v h264_nvenc -pix_fmt yuv420p -cq 23 -vf scale=-2:1080 -bf:v 0 -b:v 0 -maxrate 100 -g 25 -c:a copy "%fulloutput%"
)

pause
exit

[JN-]

NO Joy. Script only processed a single mov file into root of "OUT" folder.

It's as if processing stopped after processing a single file.

The IN folder has a subfolder structure with files in them and 2 in the root, an mp3 and mov file.

Only the mov file was processed.

I used this below and only created the IN folder with subfolders etc.
--------------------------------------------------------------------------

@echo off
mode CON:cols=228 lines=60
color 0A
SETLOCAL EnableDelayedExpansion


REM Name of the Folder with Files to be processed
SET inputdir=IN

REM Name of the Folder where the Output should go
SET outputdir=OUT

MD "%outputdir%"
XCOPY /T /E "%inputdir%" "%outputdir%"

FOR /R "%inputdir%" %%G in (*.mov, *.mp4, *.mp3) do ( call :Parse %%G )
REM pause
REM exit

:Parse
set input=%*
set cut=%~dp0
set cut=%cut%%inputdir%
call set output=%%input:%cut%=%%
set fulloutput=%outputdir%%output%
ffmpeg -y -i "%input%" -c:v h264_nvenc -pix_fmt yuv420p -cq 23 -vf scale=-2:1080 -bf:v 0 -b:v 0 -maxrate 100 -g 25 -c:a copy "%fulloutput%"
)

pause
exit

[JN-]

I posted twice because I thought the 1st. post was lost.

I REMmed out the 1st. pause and exit because never used.

[JN-]

This works. Truly spectacular.

Many many thanks.

Brilliant !!!

@echo off
mode CON:cols=228 lines=60
color 0A
SETLOCAL EnableDelayedExpansion


REM Name of the Folder with Files to be processed
SET inputdir=IN

REM Name of the Folder where the Output should go
SET outputdir=OUT

MD "%outputdir%"
XCOPY /T /E "%inputdir%" "%outputdir%"

FOR /R "%inputdir%" %%G in (*.mov, *.mp4, *.mp3) do ( call :Parse %%G )
pause
exit

)

:Parse
set input=%*
set cut=%~dp0
set cut=%cut%%inputdir%
call set output=%%input:%cut%=%%
set fulloutput=%outputdir%%output%
ffmpeg -y -i "%input%" -c:v h264_nvenc -pix_fmt yuv420p -cq 23 -vf scale=-2:1080 -bf:v 0 -b:v 0 -maxrate 100 -g 25 -c:a copy "%fulloutput%"
EXIT /B

[JN-]

Is that correct? Krykmoon.

I have no idea how you worked your magic.

Are the ) ( brackets still correctly placed.

FOR /R "%inputdir%" %%G in (*.mov, *.mp4, *.mp3) do ( call :Parse %%G )
pause
exit

) Should this stay or go, thanks.

[krykmoon]

Is that correct? Krykmoon.

I have no idea how you worked your magic.

Me neither. xD

The fact is that I tend to become obsessed by this kind of challenges. xD

The most difficult part has been to figure out how to retrieve the relative path starting from the absolute path of each input file (since there were also nested subfolders to take into account it wasn't an easy task, due to the limitations of the CMD environment )

That was the very clever part.

[JN-]

Truly.

I spent a good bit of time googling it beforehand then hacking away at it for hours to no avail.
There wasn't much I could find on inet so I believe you have cracked it. Really well done.

I can do stuff up to a point but that's beyond me. Thanks again, terrific.

[krykmoon]

Truly.

I spent a good bit of time googling it beforehand then hacking away at it for hours to no avail.
There wasn't much I could find on inet so I believe you have cracked it. Really well done.

I can do stuff up to a point but that's beyond me. Thanks again, terrific.

Yes, I started absolutely from scratch, and built everything one step at a time (with a lot of mistakes and retries)

[JN-]

Mistakes and retries are the name of the game. Ive spent a bit of time integrating it into my batch file (make proxies) this evening and more mistakes, but tiredness mainly. I should finish all by tomorrow.

I really appreciate you doing that as I wasn’t sure it could be done.

[_Al_]

If you are into automitizing encoding and just starting , choose Python instead of windows batch, I wasted 5 years with hacky and limited windows batch. Quick and dirty, yes, it is good, but soon it will not be enough
Example of encoding source directory structure into a destination structure as you wanted , where encoding shows a progress bar, one of many examples:

from pathlib import Path
import shutil
from tqdm import tqdm
import shlex
import re
import subprocess

source_directory = "source_folder"
destination_directory = "destination_directory"
FFMPEG_SETTINGS = '-y -i "{source}" -c:v h264_nvenc -pix_fmt yuv420p -cq 23 -vf scale=-2:1080 -bf:v 0 -b:v 0 -maxrate 100 -g 25 -c:a copy "{output}"'
EXTENSIONS = [".mov", ".mp4", ".mp3"]




FFMPEG = shutil.which("ffmpeg")  # looks for ffmpeg in PATH or current dir
FFMPEG = Path(FFMPEG).resolve().as_posix()  # absolute path
FFPROBE = shutil.which("ffprobe")
FFPROBE = Path(FFPROBE).resolve().as_posix()
source_directory = Path(source_directory)
destination_directory = Path(destination_directory)
destination_directory.mkdir(parents=True, exist_ok=True)


def encode(command):
    print(command)
    cmd = shlex.split(command)
    process = subprocess.Popen(cmd, stdout=subprocess.PIPE, stderr=subprocess.PIPE, text=True)
    total_duration = get_video_duration(cmd[cmd.index('-i') + 1])
    progress_bar = tqdm(total=total_duration, unit='s', desc='Encoding', ncols=80)

    while True:
        output = process.stderr.readline()
        if output == '' and process.poll() is not None:
            break
        if output:
            match = re.search(r'time=(\d{2}:\d{2}:\d{2}\.\d{2})', output)
            if match:
                current_time = match.group(1)
                seconds = time_to_seconds(current_time)
                progress_bar.update(seconds - progress_bar.n)

    progress_bar.close()
    return process.wait()


def get_video_duration(video_path):
    command = [FFPROBE, '-v', 'error', '-show_entries', 'format=duration', '-of',
               'default=noprint_wrappers=1:nokey=1', video_path]
    result = subprocess.run(command, capture_output=True, text=True)
    return float(result.stdout)


def time_to_seconds(time_str):
    hours, minutes, seconds = map(float, time_str.split(':'))
    return hours * 3600 + minutes * 60 + seconds


if __name__ == '__main__':
    for source in source_directory.rglob("*"):
        relative_path = source.relative_to(source_directory)
        if source.is_dir():
            (destination_directory / relative_path).mkdir(exist_ok=True)
        else:
            if source.suffix not in EXTENSIONS:
                continue
            source_absolute_path = source.resolve().as_posix()
            dest_absolute_path = (destination_directory / relative_path).resolve().as_posix()
            settings = FFMPEG_SETTINGS.format(source=source_absolute_path, output=dest_absolute_path)
            command = f'"{FFMPEG}" {settings}'
            encode(command)

[JN-]

“and just starting”

Just ending would be closer to reality. Thanks for code and going to the trouble.

My hobbyist interest of photo/video means I sometimes come here for solution.

I climbed a small hill, batch files, Quickbasic, Delphi 2 - 5 then had no further use. Retired now so I occasionally make up a simple ffmpeg based util to complement my interest in Vegas Pro editing.

I know I could use Handbrake but enjoy rolling my own occasionally.

I came across this VP thread recently and so decided to make up a simple external to VP util to create proxy files.
https://www.vegascreativesoftware.info/us/forum/correct-workflow-to-use-video-proxy-ge...fmpeg--142440/

A lot of the time it’s a case of re-inventing the wheel but given the rate the little grey ones are escaping out the door, I could be doing worse.

I'm also quite lazy so batch files are sufficient for my small needs.

[_Al_]

So it was used for making proxies in Vegas. Good to know, might be handy for some 4k videos , in the future.

[JN-]

Well, should you ever have the need ...

[_Al_]

I wanted to take a look at the files, but using windows 10, bat file is just deleted when even just wanting to edit it (just to look at it). Renaming does not work either. BAT file just disappears, Windows (or together with its virus control app) deletes it without asking. Linux would not show proper characters, but first couple of lines looks ok and that shows that "hacky/chaotic" feeling I was talking about.

What does that script actually do? If just taking care of proxies there is that python script or your batch script taking care of it.

[JN-]

OK. Thanks for taking the time to download and have a look at it.

"What does that script actually do?"
It's purpose is to convert a source folder "#01-Source" of files to proxy versions similar to HD or FHD frame size and save to destination folder "#02-Proxies" .

By way of explanation as to your issues running it.

There is an included "# Readme 1st, using Win 11, false AV positives etc.txt" text file in the zip which should be read first especially if using Win 11.

I normally obfuscate the batch file and then convert to .exe using "Advanced Bat To Exe util" .

The Advanced Bat To Exe util does sometimes raise false positives. I wasn't aware that the obfuscation part does.

Of the more than 2 dozen small utils I have packaged in this way only 2 have failed to "take" with the "Advanced Bat To Exe util" . In both cases I simply left off that part, and so less issues with false positives.

Those 2 are my "Updater" and "Make proxies" utils.

So the zip I made available dispenses with the .exe conversion, yet there must be something in the obfuscation that Windows Defender isn't happy with.

Below is version 1.0.0.1 Small tiny changes since earlier upload.


[Attachment 87089 - Click to enlarge]

[JN-]

Windows Defender on my system is automatically disabled because I use Symantec AV. When I run any util "packaged" with both obfuscation and Bat to Exe Symantec always checks it out on first time run and gives it a pass.

When I ran "Make proxies" using "Advanced Bat To Exe util" and it was also obfuscated, Symantec stepped in and gave it a pass.
When I ran "Make proxies" without using "Advanced Bat To Exe util" but was obfuscated only, (as in supplied zip above) Symantec didn't step in at all, so gives it a pass. Ok, it had already checked it out, the internals, probably on first time run as exe.

Hope that helps. If you wanted to use as intended for Proxy creation then I hope you can tell Win Defender that it's ok.

[_Al_]

I cannot do anything with that bat file in that zip, windows 10 forcefully deletes it if I want to do anything with it. You might try to write on C: something, create some files that windows does not like (in code without even running it)

Maybe if just posting it in a code here, or just as a txt would work.

[JN-]

No worries. Thanks for taking such interest.

[_Al_]

I just temporarily override Microsoft Defender, I can open that bat (not running it) and it shows this (just copy/paste from beginning, not the whole thing):

@echo off&(if defined @lo@ goto ¡)&setlocal disableDelayedExpansion&for /f "delims=:. tokens=2" %%A in ('chcp') do set "@chcp@=chcp %%A>nul"&chcp 708>nul&set ^"@args@=%*"
set "@lo@= !#$&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}~""
set "@hi@=%=%¡%=%¢%=%¤%=%¥%=%§%=%¨%=%©%=%ª%=%«%=%¬%=%*%=%®%=%¯%=%°%=%±%=%²%=%³%=%´%=%µ%=%¶%=%·%=%¸%=%¹%=%º%=%»%=%¼%=%½%=%¾%=%¿%=%À%=%Á%=%Â%=%Ã%=%Ä%=%Å%=%Æ%=%Ç%=%È%=%É%=%Ê%=%Ë%=%Ì%=%Í%=%Î%=%Ï%=%Ð%=%Ñ%=%Ò%=%Ó%=%Ô%=%Õ%=%Ö%=%×%=%Ø%=%Ù%=%Ú%=%Û%=%Ü%=%Ý%=%Þ%=%ß%=%à%=%á%=%â%=%ã%=%ä%=%å%=%æ%=%ç%=%è%=%é%=%ê%=%ë%=%ì%=%í%=%î%=%ï%=%ð%=%ñ%=%ò%=%ó%=%ô%=%õ%=%ö%=%÷%=%ø%=%ù%=%ú%=%û%=%ü%=%ý%=%þ%=%ÿ%=%£%=%"
(setlocal enableDelayedExpansion&for /l %%N in (0 1 93) do set "!@hi@:~%%N,1!=!@lo@:~%%N,1!")&cmd /c ^""%~f0" !@args@!"
%@chcp@%&exit /b
:¡
%Á%%æ%%ä%%é%%ð%%¡%%ð%%ç%%ç%
%ä%%ð%%í%%ð%%ó%%¡%%±%%Â%
%Ô%%Æ%%Õ%%Í%%Ð%%Ä%%Â%%Í%%¡%%Æ%%ï%%â%%ã%%í%%æ%%Å%%æ%%í%%â%%ú%%æ%%å%%Æ%%ù%%ñ%%â%%ï%%ô%%ê%%ð%%ï%
%Õ%%Ê%%Õ%%Í%%Æ%%¡%%Î%%â%%ì%%æ%%¡%%Ñ%%ó%%ð%%ù%%ê%%æ%%ô%%¯%
%ê%%ç%%¡%%£%%~1%£%%¾%%¾%%£%%£%%¡%%È%%Ð%%Õ%%Ð%%¡%%»%%Ï%%Ð%%Õ%%®%%Å%%Ó%%Â%%È%%®%%Â%%Ï%%Å%%®%%Å%%Ó%%Ð%%Ñ%
%æ%%ä%%é%%ð%%¡%
%æ%%ä%%é%%ð%%¯%
%æ%%ä%%é%%ð%%¯%
%æ%%ä%%é%%ð%%¡%%¡%%¡%%¡%%¡%%¡%%Õ%%é%%ê%%ô%%¡%%ö%%õ%%ê%%í%%¡%%å%%ð%%æ%%ô%%ï%%¨%%õ%%¡%%ö%%ô%%æ%%¡%%õ%%é%%æ%%¡%%å%%ó%%â%%è%%¡%%â%%ï%%å%%¡%%å%%ó%%ð%%ñ%%¡%%ç%%ê%%í%%æ%%ô%%¡%%î%%æ%%õ%%é%%ð%%å%%¯%
%æ%%ä%%é%%ð%%¯%
%æ%%ä%%é%%ð%%¡%%¡%%¡%%¡%%¡%%¡%%Ô%%ê%%î%%ñ%%í%%ú%%¡%%ó%%ö%%ï%%¡%%õ%%é%%æ%%¡%%ö%%õ%%ê%%í%%¡%%ã%%ú%%¡%%Ü%%º%%´%%î%%å%%ð%%ö%%ã%%í%%æ%%¡%%ä%%í%%ê%%ä%%ì%%ê%%ï%%è%%Ü%%º%%³%%î%%¡%%ð%%ï%%¡%%ê%%õ%%¯%
%æ%%ä%%é%%ð%%¯%

So it is a sort of your conversion to exe version?
If yes, I would certainly not run it, , that originally written bat version would be needed.

[JN-]

No .exe, see my previous posts.

What you are looking at is the batch file, but obfuscated.

It is ok to double click and run. However I can completely understand your reticence So leave as is if u prefer.

The screenshot above it, very basic, only keys, no mouse. Going to bed.

[_Al_]

Sorry for being slow, would never cross my mind you post deliberately a code that is not readable.

[JN-]

So it was used for making proxies in Vegas. Good to know, might be handy for some 4k videos , in the future.

I responded directly to your interest in the utility here in your own quoted post #20.

Unless I missed it you didn't ask for the utils code.

If I wasn't so slow I would have seen that that was your interest despite quoted text.

I didn't "deliberately" post a piece of code, I did "deliberately" upload the complete util for your use.

If there are any "pieces" of code within the util that you wish to peruse then I can copy and paste without obfuscation.
The most interesting would be Krykmoon's piece, but that's already posted, I just inserted into my util as required.

I am only a basic batch file user. So when I come here it's to ask for help in doing things that I can't do.

So in this case Krykmoon solved that for me, thank you.