Upscaling Resolution and Frames Per Second
12Next >
6686 41 2018-7-9
Uploading and Loding Picture ...(0/1)
o(^-^)o
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
Offline

A few of you all have been asking me to share a tutorial on upscaling both resolution and fps.
True, most editors cannot handle such a task and just "fakes it".
However, Filmora can handle the upscaling to 4K (not cinematic letterboxing) and Sony Vegas Pro 15 can render real (not double frame) 60fps.
Sony vegas Pro 15 can also handle the upscaling.

Let's start with Filmora:
After working with your clip and you have clicked export, select mp4 and click settings.
Select the following: Quality - Best; Resolution - 3840x2160; Bitrate - 80,000kbps
Click ok then export
You can try 4096x2160 but I got letterboxes on the sides.

Sony Vegas Pro 15:
Put all clips onto the workspace you intend to use.
Select File then Properties.
In the properties box, use the drop down menu for the project you want - let's go with HD 1080-60i 29.970fps)
Then select frame rate - 59.940Click apply then OK
Right click the video clip and select properties
Make sure maintain aspect ratio is the only thing checked
Click "Conform to project Frame Rate" - NOTE! speed changes to 2x by default
Click OK.
If 2x is the speed you need, adjust the length of the clip to match 1/2 way throught the clip (new endpoint)
If you want regular speed, open the clip properties again and change the playback rate to 1.000
Once the editing is done, click render
Select the mp4 file type.

There you locate the project resolution and frame rate you selected.
There were three selections on each resolution and frame rate.
This should be normal computer, video card 1 assist and video card 2 assist.
Choose what you wish.
After selecting the rendering frame rate & resolution to match project framerate and resolution.
Choose the location to save the file and click render
This will also work for 4K60


Just play around with your editor if you do not have these editors.
That is how I stumbled across the 60fps

And for the doubting Thomas out there... please examine this 60fps clip to your satisfaction:

https://drive.google.com/open?id ... LpBQI2_VIuNDsj9hZdI

preview in Google Drive will be reduced to 1080 but if you download, you will see the quality.



Any question, let me know
Credit to user Northwood Mediaworks for having me poke around at Vegas Pro 15 to accomplish this



2018-7-9
Use props
DMX_MT
First Officer
Malta
Offline

Reaĺly Big Thank You for your time PMshop !

So Interesting !
2018-7-9
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Netherlands
Offline

Did you set the resample ON on the project / clip? (Sony Vegas)
2018-7-9
Use props
A CW
Captain
Flight distance : 13864580 ft
  • >>>
United Kingdom
Offline

Good info PM shop
2018-7-10
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
Offline

Montfrooij Posted at 2018-7-9 23:31
Did you set the resample ON on the project / clip? (Sony Vegas)

Resample mode - "Smart resample" for project properties (default)

"Use project resample mode" for the clip properties (default)
2018-7-10
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Offline

pmshop Posted at 2018-7-10 00:39
Resample mode - "Smart resample" for project properties (default)

"Use project resample mode" for the clip properties (default)

Ok, that means Vegas will interpolate the frames in between.
2018-7-10
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
Offline

Montfrooij Posted at 2018-7-10 00:46
Ok, that means Vegas will interpolate the frames in between.

That is the key from what I have seen
2018-7-10
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Offline

I just downloaded the clip and it is really weird.
If you skip through frame by frame, every 2 frames are equal.
So essentialy you are duplicating frames and adding more disk space without adding anything new.
If you zoom in in Vegas in the timeline, you can use the arrow keys to skip through the frames.



2018-7-10
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Offline

Just look at the frame number in the lower right part.
You can see 469 + 470 are the same.
As are 471 and 472
So Vegas did not interpolate anything.
It just duplicated the frame.
Your eye won't notice this, but it is exactly the same as 30fps
2018-7-10
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
Offline

Montfrooij Posted at 2018-7-10 01:05
Just look at the frame number in the lower right part.
You can see 469 + 470 are the same.
As are 471 and 472

That is incorrect - I got 60 different frames.
I will make a screen cap that demonstrates this.
If you are using 14, you will not see it.
I have 14 and 15 and 14 doubles the frames while 15 makes a new tween frame

2018-7-10
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Offline

pmshop Posted at 2018-7-10 01:07
That is incorrect - I got 60 different frames.
I will make a screen cap that demonstrates this.
If you are using 14, you will not see it.

Yes please.
That makes me curious how Vegas 14 shows your file different than 15.
I did not change anything to that file, just dragged it onto the timeline.

I will try with virtualdub also.
2018-7-10
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Offline

I saw it in MPEG streamclip.
But it does look like you increased the speed 2x
So Vegas did not have to interpolate anything.
What happens if you keep the speed the same?
2018-7-10
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
Offline

Montfrooij Posted at 2018-7-10 01:25
I saw it in MPEG streamclip.
But it does look like you increased the speed 2x
So Vegas did not have to interpolate anything.

I actually 2x by clicking the conform to project, rendered the video, and then 2x again and rendered if I remember correctly with that file.

Also further proof that it is working - the "sports camera effect"
60fps generates an effect that you see common at broadcasted sporting events.
Just as seen with the file presented.

14 and 15 are different versions - 15 has a product improvement that allows you to see my editing process that 14 would not?
That would be my guess.

2018-7-10
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
United States
Offline

Here is another that I upscaled both 4K and 60fps

https://drive.google.com/open?id ... ZQbU5xgfrMR3mPYK45g

preview in Google Drive will be reduced to 1080 but if you download, you will see the quality.

2018-7-10
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Offline

pmshop Posted at 2018-7-10 01:31
I actually 2x by clicking the conform to project, rendered the video, and then 2x again and rendered if I remember correctly with that file.

Also further proof that it is working - the "sports camera effect"

Ah, learning something every day!

But do you also have one that is NOT increased in speed?
I am curious how a real conversion to 60fps is rendered by Vegas Pro 15.
In your case you are just making the frames 1/2 their duration.
So Vegas does not have to interpolate anything.
In Vegas 14 it looks horrible when you convert 30fps to 60fps and keep the duration of the clip the same (a lot of ghosting in the interpolated frames).
2018-7-10
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
United States
Offline

Montfrooij Posted at 2018-7-10 02:22
Ah, learning something every day!

But do you also have one that is NOT increased in speed?

See post #16
2018-7-10
Use props
Northwood
Second Officer
Flight distance : 2148596 ft
Canada
Offline

I am mostly using FCP X on a Mac these days, and the conform to frame rate seems to interpolate correctly...  (Optical Flow).  You dont have to mess with the speed of playback either.  Did this to smooth out the yaw sequences I am so fond of (I will get over that!).  


For Vegas users, if you are NOT going to double the frame rate, I recommend you switch off "Smart Resample" as it will butcher your image quality (if you have Vegas 13, Movie Studio, or older versions, you have to do this to each clip in the timeline, in versions 14 and 15 you can toggle this for the entire project).  I am still exploring the possibilities with all these editors... psmshop has run with it and is doing the science.  Thanks for the nod!

As for upscaling to 4k, I am not into that...  I dont see improvement, just a larger image.  Next drone will have 4k!But that will not be any time soon.


2018-7-10
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Offline


Downloading now
2018-7-10
Use props
Northwood
Second Officer
Flight distance : 2148596 ft
Canada
Offline

I should add, for the general benefit of all, there's a guy in Australia who has a pretty good set of Vegas tutorials, Derek Moran, you can find that at http://moviestudiozen.com  (he started with Movie Studio, but upgraded to Vegas shortly thereafter... as far back as version 9 or so).  He has a forum there, and is very helpful.  Tell him Northwood sent you!
2018-7-10
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
United States
Offline

Northwood Posted at 2018-7-10 04:06
I am mostly using FCP X on a Mac these days, and the conform to frame rate seems to interpolate correctly...  (Optical Flow).  You dont have to mess with the speed of playback either.  Did this to smooth out the yaw sequences I am so fond of (I will get over that!).  

We see it on our 4K 55" TV
Now, the original file cast to it looks good.
YouTube, not so much

I must try that 'switch off "Smart Resample" ' tip

2018-7-10
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Offline

pmshop Posted at 2018-7-10 04:37
We see it on our 4K 55" TV
Now, the original file cast to it looks good.
YouTube, not so much

The other clip you send is clearly showing the interpolation.
Every second frame is less sharp (since Vegas guesses what the next frame should be).

In area's where there is bigger change between frames you clearly see it.
(like in the left upper corner around 0:06:40.)
So if you would move faster, you would see more ghosting.

Today's algorithms still can't replace a camera, even though they do their best.
My advice would be to use the native resolution of the clip and only increase the fps when you also increase the speed (so Vegas does not have to guess anything)
Otherwise you are just increasing the size of the file and introducing ugly ghosting every second frame.

Now I know Youtube hides most of that issue because of their compression but that is not a reason to perform either the upscaling or the extra fps.
(my opinion of course, feel free to fill up your HD with unneeded bites )
2018-7-10
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Offline

pmshop Posted at 2018-7-10 04:37
We see it on our 4K 55" TV
Now, the original file cast to it looks good.
YouTube, not so much

Here is a 'real' frame from you Spark


And this is the next frame.
2018-7-10
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Offline

pmshop Posted at 2018-7-10 04:37
We see it on our 4K 55" TV
Now, the original file cast to it looks good.
YouTube, not so much

You can clearly see how Vegas averaged two frames in areas with sharp edges, like the lampposts (or whatever they are)
2018-7-10
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Offline

pmshop Posted at 2018-7-10 04:37
We see it on our 4K 55" TV
Now, the original file cast to it looks good.
YouTube, not so much

Indeed, I am curious how the resample : OFF works.
(maybe try with a smaller clip, so I don't have to download 2 Gb )
2018-7-10
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
Offline

Northwood Posted at 2018-7-10 04:06
I am mostly using FCP X on a Mac these days, and the conform to frame rate seems to interpolate correctly...  (Optical Flow).  You dont have to mess with the speed of playback either.  Did this to smooth out the yaw sequences I am so fond of (I will get over that!).  

Can't turn off the "Smart Resample"

You go to duplicated frames.
Not 60fps
2018-7-10
Use props
Jasta ~
First Officer
Flight distance : 500554 ft
Philippines
Offline

Thanks for this..

Do you have a sample project using Filmora?
2018-7-10
Use props
Northwood
Second Officer
Flight distance : 2148596 ft
Canada
Offline

pmshop Posted at 2018-7-10 16:10
Can't turn off the "Smart Resample"

You go to duplicated frames.

Ya, get that.... what I was saying was that for those who dont wish to go to 60fps and are editing their 29.97 in Vegas, they should remember to turn off Smart Resample, as it worsens the image quality.

Yep, needs to be on for what you are doing...  (and i'll bet you look just like your avatar!)  Ha ha!
2018-7-10
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
Offline

Jasta ~ Posted at 2018-7-10 16:49
Thanks for this..

Do you have a sample project using Filmora?

Yes, here is a Filmora sample for upscaling resolution only:
https://drive.google.com/open?id ... ISVSWAgEKivKNJqgh0r
2018-7-11
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
Offline

Montfrooij Posted at 2018-7-10 05:18
Here is a 'real' frame from you Spark
[view_image]

Whatever you are doing to my vid, that is not the quality I see at all on my stills.
You obviously digital zoomed with software.
Here is my real frame of the same shot so I would appreciate you not being disingenuine by producing false evidence.
The method I described works and it works very well.


2018-07-11 (2).jpg
2018-7-11
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
Offline

Northwood Posted at 2018-7-10 17:38
Ya, get that.... what I was saying was that for those who dont wish to go to 60fps and are editing their 29.97 in Vegas, they should remember to turn off Smart Resample, as it worsens the image quality.

Yep, needs to be on for what you are doing...  (and i'll bet you look just like your avatar!)  Ha ha!

Part of a meme I made:
2018-7-11
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Netherlands
Offline

pmshop Posted at 2018-7-11 01:45
Whatever you are doing to my vid, that is not the quality I see at all on my stills.
You obviously digital zoomed with software.
Here is my real frame of the same shot so I would appreciate you not being disingenuine by producing false evidence.

I did not do anything to your file.
I opened it in MPEG_Streamclip since Vegas 14 has this bug you mentioned and skipped through the file frame by frame.
I did not zoom in digitally, I made a 4K screen capture from my monitor and cropped that because you won't see any details in this forum if you share a 4K screen capture.
No 'zoom' (that would require image resize).

Nothing special, just to see what Vegas 15 does with this 'resample' part.

But as I said, if you are happy with the end result, just do it like you feel comfortable with.
That is all what matters right?
2018-7-11
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
United States
Offline

Montfrooij Posted at 2018-7-11 03:37
I did not do anything to your file.
I opened it in MPEG_Streamclip since Vegas 14 has this bug you mentioned and skipped through the file frame by frame.
I did not zoom in digitally, I made a 4K screen capture from my monitor and cropped that because you won't see any details in this forum if you share a 4K screen capture.

Cropping is essentially "doing something to the file".

When you cropped the screen cap, it zoomed when posting to give a full screen picture.
That gives a false representation to others as far as quality.
The cropping makes your 4K screen grab look like a 480p resolution.

2018-7-11
Use props
Montfrooij
Captain
Flight distance : 2560453 ft
  • >>>
Netherlands
Offline

pmshop Posted at 2018-7-11 03:42
Cropping is essentially "doing something to the file".

When you cropped the screen cap, it zoomed when posting to give a full screen picture.

I see your point.
That was not what I was trying to show.

I was looking for these resampled frames and how Vegas calculated the difference between 2 frames.
Essentially it looks like it blends  frame 1 and 2 and adds the average of those in between as a new frame.
(so you now have frame 1, 2, 3, where 3 is the former 2nd frame and the duration is half the original duration, since you did not change the speed)

You can see that in the lampposts from the left upper corner (or whatever these poles are).
On the 'real' frames they look like they should look (as one line).
On the 'resampled' frame it looks like there are 2 of them close together.

This effect is most prominent in area's with the most changes between frames.

If I would be allowed to post a full 4K picture here, I would not have to crop it. But since I can't, I had to do some cropping to the area where the effect was most prominent.


2018-7-11
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
United States
Offline

I understand.
You could post the 4K pic temporarily with a GoogleDrive or OneDrive link...
Then one could zoom in for inspection.
2018-7-11
Use props
Northwood
Second Officer
Flight distance : 2148596 ft
Canada
Offline


Flying the Delorean drone!  (rebate is attache case in trunk, watch who you open that in front of!)

2018-7-11
Use props
S-e-ven
Captain
Flight distance : 5922034 ft
  • >>>
Thailand
Offline

Why is clicking on your google drive link opening Ms-onedrive on my computer? And not showing any videofile?

Edit: Found the second post with the google link, thanks!

2018-7-11
Use props
Carmenvail
lvl.4
Flight distance : 1521201 ft
United States
Offline

all of this is very interesting
2018-7-11
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
United States
Offline

S-e-ven Posted at 2018-7-11 09:16
Why is clicking on your google drive link opening Ms-onedrive on my computer? And not showing any videofile?

Edit: Found the second post with the google link, thanks!

Now this is an issue.
First link had the text address to Google but hyperlink to OneDrive where I originally had it. (running out of space)

Now the real issue,
Google drive reduces the quality to 1080
Seeing what I download now from Google Drive
2018-7-11
Use props
S-e-ven
Captain
Flight distance : 5922034 ft
  • >>>
Thailand
Offline

pmshop Posted at 2018-7-11 09:24
Now this is an issue.
First link had the text address to Google but hyperlink to OneDrive where I originally had it. (running out of space)

it is not reducing if you download the file.
my player got me the 4k resolution in the metas

Nice and interesting.
it looks really good!
2018-7-11
Use props
pmshop
First Officer
Flight distance : 8073271 ft
  • >>>
United States
Offline

S-e-ven Posted at 2018-7-11 09:27
it is not reducing if you download the file.
my player got me the 4k resolution in the metas

Looks really good on that 55" UHD TV

And confirmed, that downloaded file will indeed be what I uploaded.
Preview just reduces it.

2018-7-11
Use props
12Next >
Advanced
You need to log in before you can reply Login | Register now

Credit Rules