By Jeremiah Morrill on 9/7/2008 2:42 PM

I run Vista x64 on my development computer, so it's pretty easy for me to test compatibility with 32bit and 64bit when I'm coding.  While coding some more on the WPF Media Kit last night, I decided that I wanted the WPF MediaKit to support 64bit too.  This of course is impossible with the MDX libraries.  The MDX libraries are written in .NET 1.1 and compiled for 32bit only.  Weak huh?  So based on a suggestion from one of you guys, I checked ... Read More »

By Jeremiah Morrill on 9/5/2008 3:16 AM

One big bug in the "WPF MediaKit" that I've really been putting off has handling the Direct3D device when it's lost.  Well I think I've got it licked!  See, a standard IDirect3DDevice9 will be lost (meaning you can not use it anymore and all resources in the default pool have to be recreated) in many different scenarios.  For instance if you change your display resolution, or if you switch to another user or even hit ctrl-alt-del.  In Vista, ... Read More »

By Jeremiah Morrill on 9/4/2008 6:11 AM

I'm notorious for showing off things before they are done.  So keeping with my notoriety, I have decided to give a sneak preview of the WPF MediaKit.  Keep in mind most things are largely untested.  I don't restore a lost D3D Device just yet and don't expect the sample application to be pretty.  I did spend a lot of time commenting everything, so it shouldn't be too bad to navigate.

Right now I have two "example" controls, ... Read More »

By Jeremiah Morrill on 8/30/2008 11:48 AM

In my last post about the WPF MediaKit library, I mentioned a little about the design goals and architecture.  I have two distinct, but complimentary class hierarchies.  The "MediaPlayerBase" class tree wraps DirectShow COM functionality into a DispatcherObject, running in it's own Dispatcher.  The "MediaElementBase" wraps the "MediaPlayerBase" into a nice XAML friendly, data-bindable FrameworkElement.

Today the class inheritance looks like this:

On the Di ... Read More »

Comments (4)

By Jeremiah Morrill on 8/27/2008 2:13 PM

A few of you have emailed, wondering if I'm still alive, or if I'm working more D3DImage video player.  The answer is "YES!".

I have been very busy with work, but I found some time here and there to work on what I am calling (for the lack of a better name), the "WPF Multimedia Library".  Sounds pretty self explanatory, no?  The quick synopsis, it's a lib to quickly and ea ... Read More »

By Jeremiah Morrill on 8/17/2008 6:34 AM

... Read More »

By Jeremiah Morrill on 8/12/2008 2:28 AM

The new D3DImage in ... Read More »

By Jeremiah Morrill on 8/11/2008 11:52 AM

Read More »

By Jeremiah Morrill on 5/21/2008 2:41 PM

I've been playing around with the new WPF 3.5 SP1 beta lately and I wanted to test the performance of the new WriteableBitmap in comparison to the VRE.

The test simply copies the same pixel buffer to the WriteableBitmap or the VRE at a specific interval.  This way we can see the raw CPU it takes to just update pixels.

For this test, I ... Read More »

By Jeremiah Morrill on 4/28/2008 8:24 AM

Pavan released his now popular ElementFlow control about a month ago.  Dissecting his code was both a pleasure and very educational (It was written much nicer than my version).  The coolest part was how he sub-classed a Panel and overlayed a Viewport3D on top.  Being a sub-class of Panel, you have all the nice built in WPF functi ... Read More »

By Jeremiah Morrill on 4/19/2008 8:33 AM

I've spent a lot of time tuning up the VRE to be as flexible as possible as to support advanced media scenarios, such as DVDs.  Things are not easy given the nature of DirectShow, WPF and the MediaElement (the 3 essential ingredients of VRE).  For weeks I have been pondering on the new features Microsoft is releasing for WPF, such as the pixel shaders, new Writeab ... Read More »

By Jeremiah Morrill on 4/16/2008 6:11 AM

So I have pretty much finished the DirectShow Renderer, which is a glorified SampleGrabber and I started testing the DVDs with it.  For some reason Microsoft's DVD Navigator filter will only play the FBI warning and stop.  I swapped out MS's DVD navigator with CyberLink's and it played fine!  I did some tests with the "Dump" filter from the DirectShow SDK and it only did the FBI warning also.

Could this be some anti-piracy feature ... Read More »

By Jeremiah Morrill on 4/15/2008 5:00 AM

In my last post I talked a little about how I was modifying the VRE to support it's own DirectShow Renderer.  This is to get around how crappy/inflexible the SampleGrabber really is.  The DirectShow renderer I have made is really just a glorified SampleGrabber which is very simple and probably won't be more than 20 LoC when it is finished ... Read More »

By Jeremiah Morrill on 4/13/2008 4:02 AM

If you've been reading this blog this week, you probably noticed am attempting to make a WPF control that allows a developer to play DVDs rendered WPF.  I had some reasonable success, but the project had to be hard-coded way to much.  For instance I required 3rd party DVD filters and two (count them, TWO!) FFDShow filters to even make the DirectShow graph work.  The problem lies in the design of the VideoRendererElement.  I expected to always be able ... Read More »

By Jeremiah Morrill on 4/10/2008 9:22 AM

Here's the video of Interactive DVD menus working.  I made it out to be hard, but really it was so easy I don't want to say.  Should work fine on 3D too!

BTW, If it looks choppy, that's the encoding.  Local its smooth and I have it down to 5% CPU now :)

 

By Jeremiah Morrill on 4/10/2008 7:09 AM

I was asked by some peeps about how the multi-media pipeline (DirectShow) works and also how it relates to WPF.  I've decided to write a little post to cover all this.  I've tried to keep it as high level has possible.

DirectShow

DirectShow is the multimedia framework in Windows.  Most media players that run on windows use DirectShow, including Window ... Read More »

By Jeremiah Morrill on 4/10/2008 3:11 AM

Here is a video of what I was able to do so far with the VideoRendererElement and a DVD.  I'm showing the DVD title screen so you know it truely is the DVD and not some rip.

*UPDATE*  Woo, got it down to 8% CPU usage, but I still have some unnecessary overhead I can get rid of.

 

Read More »

By Jeremiah Morrill on 4/9/2008 3:53 AM

I've read quite a few posts (and lots of bitching) about how the MediaElement does not support DVD playback.  With the VideoRendererElement, this should be possible...but not without its hurdles.

It seems as the authors of the DVD decoder filters don't like you creating a sample sink (ie SampleGrabber filter), probably for obvious reasons, such as pirating.  I need this sample sink so I can feed the VideoRendererElement some samples to render.

I have come across some c ... Read More »

By Jeremiah Morrill on 4/5/2008 2:18 AM

I've spent some time this weekend working on the VideoRendererElement, cleaning up the source, commenting, bug fixing, etc.  The source-code is now correctly in CodePlex so you can now browse it.  I also made a few breaking changes to the API to support flagging a sample as a keyframe, so comp ... Read More »

By Jeremiah Morrill on 3/31/2008 4:23 PM

I keep going on and on about performance of the VideoRendererElement...well because I think it's important that peeps know.

As you can see in this video that the webcam is indeed in WPF space (reflection).  It is doing 640x480x30FPS live from the camera.  I show the Task Manager running about about 4 - 6% CPU.  Playing the webcam in regular graphedt.exe (not in WPF) yields about 4% CPU usage.  So most of the CPU tax is on the webcam ... Read More »

By Jeremiah Morrill on 3/30/2008 11:12 PM

The VideoRendererElement..well I'm sure some of ya'll are tired of hearing about it.  But the beta is on Codeplex with a sample that shows you how to get a capture source (webcam) in WPF along with the GDI and compressed sample example.

There's some bugs left it in..and definitely a little refectoring needed.  I don't think the VideoRendererEle ... Read More »

By Jeremiah Morrill on 3/28/2008 5:14 PM

I think most people know what VLC is.  I figured VLC API could be a good example of a use case example for the VideoRendererElement. 

So I remember coming across a gentleman that made a WPF player that used VLC to decode the video.  The problem is the frames were updated with this code ... Read More »

By Jeremiah Morrill on 3/28/2008 3:46 AM

I posted up a preview build of the VideoRendererElement on codeplex here.  I also posted a notification on the WPF forums here.  I have posted warnings that it is very much a preview and very messy right now. 

Feel free to contact me about any questions/jokes on it. ... Read More »

By Jeremiah Morrill on 3/27/2008 12:06 PM

Last night, I changed the API of the VideoRendererElement to be synchronous, which makes things easier on the consumer developer, but I'm not entirely happy with how its implemented.  Though it should work just fine for production.  Here's the story:

There is a DirectShow filter I have made that works behind the scenes, that allows all the "magic" to happen.  This filter inherits from CSource and the filter's pin inherits from CSourceStream.  Really, inheriting from ... Read More »

By Jeremiah Morrill on 3/26/2008 1:02 AM

Here is a screen-shot of the VideoRendererElement I posted about yesterday.  What you are seeing is a basic System.Drawing.Bitmap at 640x480, with Graphics class running FillRectange(), then FillEllipse() on it.  The Bitmap's buffer is then sent to the VideoRendererElement at 30 FPS...all around 1 - 2% CPU usage.

Read More »

By Jeremiah Morrill on 3/25/2008 4:24 PM

When I first started using WPF, the first thing I messed with was the MediaElement, after all, I am a nut for video.  I found the MediaElement only allowed you to supply a source Uri to your media.  It sadly did not allow any API access to write your own custom video.  WriteableBitmap was more of a convenience API and marked certain death for any high-performance application.  What if somebody wished to add a web camera to their application, in which ... Read More »

By Jeremiah Morrill on 3/18/2008 12:57 AM

I was pretty impressed when I saw the head tracking with the Wii remote hack.  I was also very impressed by Rick Barraza's Minority Report-like gloves used with WPF.  I wanted to see what was possible with a little computer vision.  Below is a video of my attempt at the head tracking.  As you see, the algorithm needs a LOT of fin ... Read More »

By Jeremiah Morrill on 3/18/2008 12:35 AM

When I heard about the new, high-performance WriteableBitmap coming in .NET 3.5 my ears perked a bit.  Could this be what us video nuts need to dump the WPF MediaBridge once and for all?  Maybe...but probably not.  The new WriteableBitmap lets you write directly to the pixel buffer and tell WPF which a ... Read More »

By Jeremiah Morrill on 3/14/2008 4:00 PM

Someone requested to see the video for the 3D Item flow control I had.  Here it is :)

 

Read More »

By Jeremiah Morrill on 3/13/2008 8:26 AM

At work, we have a small team working on a WPF application to supplement our web-based UI.  Of course, us being software developers, we can be really lame when it comes to design and I want our application to look decent until we bring a real designer on board.  I have told people that I'm good enough at design to know when something looks bad.  So I naturally scour the Internet's series of tubes, searchin ... Read More »