yashsingh1/xdaforums huggingface dataset:
[Shield General] cgutman:
It would probably be best to start with Moonlight Embedded and do a bit of hacking on the video decoders. https://github.com/irtimmer/moonlight-embedded/

Perhaps starting with the SDL renderer would get you where you want: https://github.com/irtimmer/moonlight-embedded/blob/master/src/video/sdl.c

Rather than pushing the YUV frame out to the SDL main thread, you can do whatever processing on it (or perhaps conversion to RGB if that's more usable for OpenCV).
[Shield General] tonu42:
Nexus 6 overclock to 2.7ghz with EX kernel getting 11ms hardware decode and average 14-17 latency.

Very playable for most games using wireless AC, tplink AC1750 router.
[Shield General] sunkzero:
Hi,

I just started using Moonlight today and I'm having a problem with the mouse.

If I move the mouse quickly it works and responds as expected but slow, small and accurate movements are basically not recognised at all.

I've tried different mice and two different destination PC's (I'm using the Chrome streamer). Serving PC is using a GTX780ti. I can also confirm enhance precision is off on all the PC's. The streaming is otherwise spot on perfect!

Hoping you can help...
[Shield General] cgutman:
Can you tell me more about the client PC (running Moonlight) (CPU/GPU/OS/anything else that might be relevant)?
[Shield General] Darriousx:
Wow... this literally just worked for me and I have been trying to figure this out for DAYSSSSSS! I thought all my ports were forwarded and it was an error on my part. Thankfully it was simply Nvidia had updated their Gamestream external IP protocol.

Edit: Maybe it doesn't work. RTSP Handshake issue lol
[Shield General] nk33:
well its finding the correct path at least.

reboot everything should sort the rtsp handshake issue out
[Shield General] sunkzero:
OK here are all the specs (straight from Speccy :P ); I tried it on two different client machines with the same result, and I tried two different mice:

SERVER

Intel Core i7 4930K @ 3.40GHz

Ivy Bridge-E 22nm Technology

32.0GB DDR3 @ 1199MHz (11-13-13-32)

ASUSTeK COMPUTER INC. RAMPAGE IV BLACK EDITION (LGA2011)

3071MB NVIDIA GeForce GTX 780 Ti (ASUStek Computer Inc) x 3 SLI (SLI was DISABLED)

CLIENT 1

Windows 8.1 Pro 64-bit

Intel Core i5 3570K @ 3.40GHz

Ivy Bridge 22nm Technology

8.00GB Dual-Channel DDR3 @ 804MHz (11-11-11-28)

ASUSTeK COMPUTER INC. P8Z77-V PRO (LGA1155)

3071MB NVIDIA GeForce GTX 780 (EVGA)

CLIENT 2 (streaming was impressive even on this relatively low powered NUC, just the same mouse issue)

Windows 10 Pro 64-bit

Intel Core i3 4010U @ 1.70GHz

Haswell ULT 22nm Technology

16.0GB Dual-Channel DDR3 @ 798MHz (11-11-11-28)

Intel Corporation D34010WYK (CPU 1)

Intel HD Graphics Family (Intel)
[Shield General] Reechings:
Well I was trying to be optimistic that it might work but my crappy 2Mbps upload speed from my home internet has killed my plans to use moonlight to play my games while on vacation. Any idea what the minimum required for the various options are? In a perfect world I would like to do 1080p at 60 fps.
[Shield General] vaakel:
whats about x92 tv box with s912, should i expect high latency?
[Shield General] nk33:
I have a galaxy s8. When I run moonlight to play a game, it goes straight in, full screen, no problem.

However, if i run tridef, it opens Tridef and I can see the desktop, but it opens up in a quarter of the screen of my phone. The problem here is I cannot read what game I am clicking to open. I cannot zoom in either.

I have tried ticking and unticking the stretch option in Moonlight. Both give same result.

Can anyone suggest anything?
[Shield General] sunkzero:
Hi - did you have any thoughts on this please?
[Shield General] diablos222:
Well, the minimum requirement is 5Mbps, but for 1080p 60fps I suspect you would need something around 12Mbps.
[Shield General] bluegizmo83:
If you don't mind lowering the quality settings you might be able to get by with a 2Mbps upload speed. Under "resolution and fps Target" set it to "720p 30 fps" and then under "Target video bitrate" move the slider down to "2Mbps".
[Shield General] dreadkopp:
Hey guys.

on the moonlight-app we've got a button to 'quit current app'. However i found a problem that i am left with a stream of the desktop after closing a streamed app (happens mostly with manually-added games which run a launcher first and / or aren't set to run fullscreen). Therefore i'd like to put a shortcut on the dekstop which closes the current session (either by closing the current connection or - the hard way - by disabling and enabling gamestream server ). Before i dig through many forums / docs (if even available) and spend hours try-and-error i thought it would be smart to ask here first :)

Cheers
[Shield General] bluegizmo83:
Yeah I get that all the time too. I just swipe from the edge of my Android screen to get the navbar buttons to show up and then click the back button. That will take you back to the Moonlight game selection screen (with the stream still running on the PC) and then the game you were just playing will have a Play icon on it, click on that game and then click Quit Session.

---------- Post added at 06:23 PM ---------- Previous post was at 06:04 PM ----------

[MENTION=2844433]cgutman[/MENTION] I have a feature request if you have time to do so.

Nvidia doesn't seem to want to let people remove games from the gamestream list once the games have automatically been scanned by GFE. Because of this my gamestream list has several duplicate games that show up (a few games even have three and four duplicates) and I can't do anything to remove the duplicates (besides uninstalling the entire game which I don't want to do). It would be awesome if you could add a way to hide games from within Moonlight.
[Shield General] JasonS7notG5:
I mentioned this on github but no one replied...

I would say this is "simple" to implement but I am not a programmer.

But first the devs should finally fix the micro stutters without increasing latency. As of now we have the option for micro stutters but no latency (official app) or no micro stutters but with noticeable latency (APK build here).
[Shield General] diablos222:
Anyone else cant use moonlight after latest 3.8 GFE release? I can connect to PC, pick a game, but after few seconds of black screen I get message that the connection was terminated.
[Shield General] bluegizmo83:
I know sometimes when Nvidia updates GFE they change things and it breaks Moonlight until the dev can update the app, but that doesn't appear to be the case here. I'm on GFE 3.8.0.89 and Moonlight 5.1.1 and everything still works fine for me.
[Shield General] diablos222:
I see, thank you. I will reinstall GFE.
[Shield General] bluegizmo83:
Your welcome. I'm not sure what else could be causing that issue, did it work properly before you updated GFE? Do you have all the correct ports forwarded in your router?
[Shield General] diablos222:
I didnt have issue with it before. I just reinstalled 3.8.1 Beta again and it still didnt work. Same issue. I will try with 3.8.0.

EDIT. It works with public version 3.8.0. I noticed that there is highlight feature in Share settings and I think it wasnt there in 3.8.1 beta.
[Shield General] bluegizmo83:
Ah ok, glad you got it working. It's usually best to stick to the public version for best compatibility. I think the Moonlight dev usually only puts out update fixes if things break in public GFE builds.
[Shield General] dreadkopp:
Thanks for your answer but that won't help me since i am using a modified version of the chrome-app. i can alt+tab out of it and then close the current stream via console but that is not very user-friendly :)
[Shield General] bluegizmo83:
[MENTION=2844433]cgutman[/MENTION] Hey man I found an issue with Moonlight on my Nvidia Shield Tablet. I'm running the latest 5.1.1 Moonlight and I can't get the Wake On Lan function to work. Its got to be an issue with Moonlight on this device because WOL works fine from Moonlight on my Nexus 6p phone, and WOL works from my Shield Tablet using an app called Wake On Lan. Attached is a LogCat taken while I was trying WOL in Moonlight.

Edit: ok, weird, I tried it again today and now it's working on my tablet all of a sudden. Not sure what's changed and why it wasn't working yesterday though...
[Shield General] Simple_DNO:
Sorry for my english.

I'm trying to get "open source Vive" setup with my phone and USB streaming and there is problem with mouse pointer locked to main screen (and main screen is fullscreen SteamVR app, which goes to the phone, while input - mouse and keyboard - needs to be send to the game in other window on 2nd screen). So when I'm not running stream, everything works fine, I'm opening full-screen SteamVR, on second display (just VGA dummy plug) I'm making game window active for reading input and everything works just fine. But when I'm enabling stream, mouse locks in the borders of display 1, so the moment I click mouse, focus switches to SteamVR and game reads no user input.

So is there any way to avoid it? Frankly I don't need input from phone at all, only a picture.

Everything else works just great, 11ms on snap 625 at 1080@60fps (xiaomi) via USB, also managed to install head tracking (opentrack) and SteamVR fake driver for it (OpenVR opentrack), so I can see very nice picture and move my head, and even managed to get workaround for keyboard (autohotkey script), just can't control app with mouse.
[Shield General] eliott94260:
[MENTION=2844433]cgutman[/MENTION] it will be cool if you can port gamestream co-op feature on mobile : gamestream and gamestream co-op work on same protocol (when i try gamestream co-op Moonlight say "quit and run app) so I think it's possible to make android app
[Shield General] nielo360:
EDIT: Ran 1st test with shield itself, Used it to play rage,borderlands as noted by the dev there is a delay with Tegra device, the d-pad on the shield did not work,

other buttons worked fine,otherwise streaming is really good. Excellent work! will run a few more tests, and test with z ultra with moga pro .. looking forward to a donate version!

EDIT2: z ultra has lot of blocks black and green etc randomly showing up, streaming is fine and smooth despite that, Moga pro HID mode right stick and dpad dont work :( :( :( only works in native shield streamer so far, ps3 controller worked except the button mapping is a little off, hope you can find they way xinput is emulated would be great:)

In the shield native streamer all or most HID controllers work fine in emulating the 360 controller, however outside that with splashop and droidmote thats not the case.

Have you implemented xinput controller support in this similar to shields? if so would any HID controller do or are you using a wired 360 controller attached to your android device?

Would be awesome if you have found a way to emulate xinput with HID controllers. Droidmote does this but it currently doesnt work with HID d-pads.

---------- Post added at 12:01 PM ---------- Previous post was at 11:29 AM ----------

Splastop is cpu based, that includes Splashtop THD which just has a few optimizations for tegra chipsets (which are now in splashtop personal too), This app uses gpu based encoding same as the shield and its got something to do with how nvidia has implemented their streamer with regards to tegra devices, which I guess will need to be resolved.
[Shield General] Streykatorato:
I have a Quadro 2000m in my Laptop and a Geforce 8800GT in my desktop. Is there any way i could get Geforce Experience running with streaming support on atleast one of them? I have a Nexus 7 Tegra 3. Could test it on Note 3 too! Just asking;)

I have Splashtop THD running on both devices! THD works on Note 3 btw;)
[Shield General] cgutman:
In theory, any controller that shows up as a gamepad in Android is supported. The big issue with controller mapping on Android is that nobody actually standardizes their button and joystick mappings. For example, the Ouya controller's right stick X and Y axis are MotionEvent.AXIS_Z and AXIS_RZ, while Xbox controller is AXIS_RX and AXIS_RY. The Xbox controller uses AXIS_Z and AXIS_RZ for L2 and R2.

The controller issues just need more widespread testing since there are so many different mappings. So far the PS3 controller is the best supported (both over USB and Bluetooth). I did notice the SixAxis app has a rotated button mapping by default which may have been the issue you were seeing (PS3: X was Xbox: X, and so on).

The DPAD stuff is broken on the Xbox controller (but working on PS3) so I have something I can test with locally. I can also look at the DPAD stuff on my Shield. I'll see if I can find some documentation on the Moga Pro controller and how it is doing DPAD (possible similar to Xbox) and right stick so I can fix that for you.

The random blockiness is probably just the result of packet loss or reordering. Since UDP doesn't guarantee packet delivery or packet order but we must reassemble the H264 NALs in order, I have to drop NALs when they lose packets. I think what Nvidia is doing with Shield is keeping a packet queue of the last several packets to search when they see a packet sequence number they weren't expecting (there's some logging messages that seem to indicate this). I'll probably implement a similar solution.

EDIT: The latest APK fixes the Xbox controlller (and Shield) d-pad. I've attached it to this post. It would be great if you can test this on the Moga controller.

EDIT 2: I looked up some documentation on the Moga Pro controller and found out that they're doing some really janky stuff. The controller itself doesn't send entirely Android standard keycodes for the buttons, so the SDK defines new keycodes that replace Android's constants so the controller works as expected. The Ouya controller also does a similar thing although the button mappings are even crazier (dpad left is select, dpad right is start, L3 is L1, R3 is R1, A and U are swapped). The Ouya software itself seems to fixup these values since the values I see in Limelight on the Ouya are correct, but other Android devices see the non-fixed key mappings. In Moga's case, there's an app on the Play Store called MOGA Universal Driver which appears to do the same mapping stuff that SixAxis does for the PS3 controller. I'd imagine that using this app would fix Limelight's controller mappings.
[Shield General] nielo360:
EDIT: Moga pro, only the left stick works properly, in A mode using Moga universal driver, (the right stick up and down seemed to be mapped as triggers) A, B, X ,Y, start, select, RB , LB seem ok.

Dpad, right stick and triggers are an issue.

In A mode moga pivot app it does not work

in HID mode using Moga pivot app only left stick works properly and the rest is same as above.

if you can tell me a way I can see the keys the moga pro is using i can send you a list of which keys are mapped to which button on the device.

Im going to test this out, I do have the moga universal driver installed however it only works for me in A mode which is moga's propietery mode, this mode for some reason works perfectly with shelds native streamer. HID mode just gets detected by android itself.

The ps3 controller is supported natively on the xperia z so I havent used the sixaxxis pair tool.
[Shield General] cgutman:
Can you list which buttons on the Moga pro are working properly? I think I know what the issue is with the right-stick and I'm trying to come up with a reasonable fix for it.
[Shield General] nielo360:
left stick,A, B, X ,Y, start, select, RB , LB seem ok.

Dpad, right stick and triggers are an issue. the right stick up seems to be Rtrigger and down seems to Ltrigger.
[Shield General] cgutman:
Please test dpad, right stick, and triggers on this APK.

EDIT: Sorry, I made a mistake in that APK. I've replaced the attachment with a fixed version.
[Shield General] Streykatorato:
Anyone?
[Shield General] cgutman:
This isn't really the thread for this, but neither of your GPUs are Kepler-based which means they aren't currently supported by GFE streaming.
[Shield General] nielo360:
BRILLIANT!! youv done it, Moga pro on HID Mode works perfectly! could you give some details on how you mapped these buttons it would be a great help with droidmote, or perhaps a way to use our controllers as windows controllers using this method.

only some minor issue with the deadzone being a bit too much for the sticks otherwise its perfect. (this might be input latency ill check with the ps3 controller later.)

also how do i donate?
[Shield General] cgutman:
Glad to hear it's working. The documentation on Moga using the native Android API was pretty sparse.

The left stick is AXIS_X and AXIS_Y which is the same as pretty much all controllers. The right stick is AXIS_Z and AXIS_RZ which seems to be pretty standard for Android too (although Xbox uses AXIS_RX and AXIS_RY instead).

The D-pad shows up as AXIS_HAT_X and AXIS_HAT_Y (like the Xbox controller).

The very odd one was the triggers. Unlike Ouya which used AXIS_LTRIGGER and AXIS_RTRIGGER, the triggers on the Moga are mapped as AXIS_BRAKE and AXIS_GAS. I got the idea for trying this from another thread about the Moga Pro: http://xdaforums.com/showpost.php?p=44865063&postcount=9

If you want to check out the code, it's in Game.onGenericMotionEvent(). https://github.com/cgutman/limeligh...39f606c0246d/src/com/limelight/Game.java#L364

I'm not sure about taking donations yet but I'll update you guys when I figure things out.
[Shield General] LVNeptune8:
No clue...I dig what ya'll are doing it's just not Shield related...
[Shield General] yousirname1:
Just tried this on my S4 and I'm blown away by the proof of concept. Sure, the streaming is still pretty bad (could be my end: g router), but it's quite amazing how it functions like a shield. Geforce Experience compatible games are automatically changed in the settings to match the streaming resolution and once streaming ceases, they're changed back. I had a little trouble at first, but after forwarding all the correct ports I got both the streaming and xbox controller input to work. This is fantastic work and I cannot express how excited I am to see this IN MY HANDS!
[Shield General] raufemann:
There is something to do on PC?...

...to get Limelight working? I am typing the IP and clicking on pair button and start streaming but nothing happens, just black screen and timeout connection, I have GFE 1.7.1 and nvstream and nvserver working but can't stream, I am trying this on my Shield because I have a Clevo with 680m (optimus) and nvidia don't support streaming from mobile GPU at the moment (and I guess they never will).

Thanks in advance and sorry because my english speak is limited.
[Shield General] danielb7390:
If shiled doesn't work this won't work either. It uses the same technology. You have mobile gpu witch are NOT supported
[Shield General] Aaronneyer:
If you have a Kepler based mobile GPU, you could try this: http://xdaforums.com/showthread.php?t=2394478

EDIT: Actually I guess that doesn't work for Optimus
[Shield General] raufemann:
Thanks.

---------- Post added at 03:24 PM ---------- Previous post was at 03:15 PM ----------

Thanks, I tried that but no luck.

Splashtop THD work fine with windowed (splashtop don't support direct access) mode but controls are bad.

My hope was Limelight but like said before it don't support too because it is using the same stream method.

Optimus is a bless to the battery but a pain in the &@$& with other purposes like that and I think Nvidia isn't care about mobile Kepler devices or this Optimus **** and the laptop bios are the rock on the road to make gamestream work on mGPU.

Thanks again to everybody.
[Shield General] simpelsense:
thank you very much for your effort to bring us the gamestreaming over to other devices.

my finger was already hovering over the purchase button for a shield and a nvidia card. was still undecided. now i orderd only the card :p

keep up the good work, i will test as soon as my nvidia card arrives.

if you add a possibility for donation, you have allready earned a beer.
[Shield General] nielo360:
wrong. controls are the same as 360 controller and it is fullscreen.

http://xdaforums.com/showthread.php?t=2506438
[Shield General] raufemann:
On optimus laptops no, just windowed mode, some games don't have this option believe me.

About the droidmote, tried to install ir on Windows Pro 8.1, with signature driver checking disabled and no luck.
[Shield General] bunchies:
can you add an option to cast screen?

i was thinking about playing minecraft from my pc on my raspberry pi but minecraft inst supported by geforce experience
[Shield General] tallnerd1985:
Add Minecraft to the Steam Library in the options "Add Non-Steam Application" then you should be able to play it now.
[Shield General] Motawa88:
Insetad of buying a 5ghz router imcould instead just buy a good 5ghz pcie wificard for my pc and connect with my android to my pc over connectify... Right?
[Shield General] bunchies:
cool, but for some reason i a blue screen the second i start the stream after pairing on either my phone or Raspberry pi

blue screen error is: nvlddmkm.sys 0x0000007E

ive tried going back to stock ect.. trying to see if it was a overclock issue

does anyone know of Geforce experience requires any type of service or something. i like to tweak/disable things in windows 7 i don't use
[Shield General] tclark232:
expected ouya performance?

I've got a GTX 770 & an ouya, and I'm trying this out today. Everything is hard-wired on a gigabit switch.

Latency is pretty good regardless of video mode, but compression on 1080p is *terrible* with Bioshock Infinite. On 720p/30 it's pretty good, but I'm a bit confused. I don't think 1080p is supposed to be so broken.

I don't want to buy a Shield, so can someone chime in? Is this something I can debug in my setup or is it a limitation of limelight?

Or a limitation of ouya?

Or a limitation of gamestream?

Or a bug that's gonna be fixed? :)

Thanks!
[Shield General] tallnerd1985:
It should be very possibly to have LimeLight cast the audio/video to Chromecast and use the phone as the input manager.

I know currently we are setup like this with LimeLight:

But with ChromeCast, the phone would upload a small client to ChromeCast to receive the audio/video from the GFE card but the phone would still function as the input manager. If its done, it would look something like this:
[Shield General] irtimmer:
The only difference I notice is the use of Java 8 and the resolution (I use -720). So try the default supplied JVM bij Raspbian (Java 7) and a lower resolution to check if it solves your problem.
[Shield General] cgutman:
We know the cause of the 1080p issue. The bitrate in the current configuration we're sending is always set to the value for 720p60, which makes it run much blockier since the bitrate should be higher for 1080p. It should be fixed in the next release.
[Shield General] tclark232:
Awesome! If we could configure the bitrate as well it would be fun for pushing the limits on a wired link.
[Shield General] tutchthesky7:
GOT IT!

What timing to reply to me :P I literally just a few hours ago got it working with literally almost 0 delay, the only difference from before, is that I wont boot into the GUI before launching limelight, just straight from the command line after logging into the pi! ( still using JAVA 8 )

I also ran:

sudo apt-get install ant

sudo apt-get install libopus-dev

sudo apt-get install libasound2-dev

( wasn't 100% if these were for development purposes or not ,but installed them regardless[ UNDER THE COMPILE SECTION FROM THE GITHUB])
[Shield General] cgutman:
Request for testing: New Limelight build

We've done some modifications that significantly improve image quality on all streaming settings (especially 1080p). We've also fixed a latency issue found by irtimmer and reduced the CPU usage of video. Please report any new (or old) issues and report on how the performance and image quality is during your testing.

60 FPS is particularly improved for 720p and 1080p, so give it a try.

The attached APK is the ARM version.
[Shield General] Motawa88:
thank you. The galaxy note 2 and a gtx 660 TI will be powerfull enough, right?
[Shield General] cgutman:
Yeah, that should be plenty.