Both flash SWF and Unity3d objects must be loaded in browser on webpage or (possibly both pages active at same time, this I haven’t tried)

The described process below is ideal for taking a snapshot of image data from flash and sending it to unity, currently this works best at sending 160×120 pixels RGBA which is very low res, but probably ok for motion tracking and some AR techniques in terms of speed, even for simple facial texture mapping for game characters, but there is no reason this couldn’t be scaled, however as it is web-based it is important to consider the speed of users machines.

The Current Working ActionScript code looks something like (pseudo-code):

SetupCamera, Bitmap (320×240)
Set up socket (localhost,port 8080)
Set up Connect timer,started
Set up SendData Timer,stopped
Connect Timer Function {Connect}
On Connect Init Listener{Send Data Timer Start, Stop Connect Timer}
On Close Connect Listener{Reset Timers, Re-Connect}
On Errors Listener{try..Catch then Close Connect(null) – Re-Connect}
Send Data Timer Function{if not connected connect, get Image from cam, scale using matrix (160×120), get bytes of bitmapdata, send data }

The current Unity.cs script looks like (pseudo-code):

Declare vars: texture2d,pixels color array, material, thread, TcpClient, is running bool, sent policy bool etc
Start: Set up thread function, Put pixel data to chosen material, thread function starter
LateUpdate: Copy any pixelsdata[] to texture, Update
Thread (see forums on thread scripts): {
Try Setup 8080 listener, Try GetClient Get Stream, While !Pending Sleep else
if (connected and data, haven’t sent policy), send policy(see above), set policy sent bool true,
if (connected and data, have sent policy), Read Bytes from stream (160×120x4) if complete process bytes to pixeldata
Catch all errors, solve problems.
OnDisable: (important otherwise web-browser crash when leave site): Close Connection, Close Thread, Reset Vars
OnAppQuit: Close Connection, Close Thread, Reset Vars

Thats about as far as I can go for now, and this should have given enough information, including the posts above for coders to get this working, Hope this helps.

By the way, I stumbled across a cunning way to get the memory address of flash bitmap data, but due to sandboxing and security, no way of passing this to unity in webplayer plus its probably local memory adress so would require base address, if any devs have any ideas or indeed anyway of accessing the browser clipboard from unity or accesing unlocal memory address in webplayer, I would be keen to hear from you, although to my knowledge for security reasons I understand why this should not be possible.

Well done!

I’m trying very hard to understand what’s going on here. Could you point me in the right direction as you offered to Daniel above? Any help would be hugely appreciated!

Many thanks in advance,

-r

It is working but I keep getting lots of errors in the console.

“Assets/DynamicTerrain.js(26,25): BCE0044: expecting an identifier, found ‘?’.” etc

Any idea why this is happening.

Thanks!

Sorry for the wait, we had a few problems to solve here at FusedWorks HQ… In your project view you must have a folder named Plugins, with the Perlin.cs file placed in it, then you must also have an empty gameobject without a mesh attached ie: remove the plane mesh component, then just attach the script above to the empty gameobject, the mesh for the game object and mesh renderer are created for the gameobject automatically in the script: –

gameObject.AddComponent(MeshFilter);
gameObject.AddComponent(“MeshRenderer”);

There may also be a possibility, if this isn’t working that the Perlin.cs script isn’t working due to having an Indie License and it not supporting plug-ins, in which case you need to take the above code, convert it into C# and add it to the Perlin CS script, then attach that new script to your GameObject (which is a little trickier depending on your coding knowledge), hope this helps and let us know how you get on!

PS:- you could download the package file above where it reads (downloaded here) and import it into you project, I think I put a prefab gameobject in there which you can just drag to stage once imported.

This all remains to be seen although one thing I am sure of, is that when I release the first draft i’m hoping the community will overhaul and help with optimisation. What would the feelings be on setting up a SVN Depository with GoogleCode in the near future?

Very interesting, I look forward to seeing Unity being used for AR!