It was the first time using it and I quickly found out it likes to translate a sentence or UI element too early/ahead of the rest and will not retranslate until you pull the phone away and refresh the image for Lens.
This isn't so bad when you have 2 brothers to choose from to hold the phone for you, but there has to be a better way.
Fast forward to last night, I decided to have a play with the idea again.
Its pretty simple really.
Install virtual camera to OBS. Not the inbuilt one use this one https://github.com/miaulightouch/obs-virtual-cam
Have the virtual camera as a separate scene and put a black frame over it, set up separate hotkeys in settings to show and hide this layer.
Install Bluestacks 5 Android emulator for Windows and Google Lens
Setup Bluestacks to run off the virtual camera, and feed the virtual camera your console stream, you may want to make this a new device/scene off screen to your main.
Open Google Lens and you should have a feed of your console in the emulator window, tune the OBS virtual camera size in its scene to be smaller and avoid the Google Lens UI.
Capture the Bluestacks window in OBS, be sure to have Bluestacks on screen, if its offscreen or minimized it wont run video.
Setup default, the virtual camera should run 1080p 60fps, if something is wrong it will do 30fps.
Now this next part is optional but makes for smooth super fast translations.
Make an Autohotkey script that presses the show hotkey for the black layer we made earlier, followed by a 50ms pause then the hide hotkey followed by a 100ms pause.
I personally made an Arduino do it for me on a foot pedal.
This is a real game changer, no more holding a phone, missing half a translation or having to flick the phone away from screen and back again, or needing a phone at all for that matter, now the translation is mostly auto but instant when you stomp that button!
This isn't limited to games, it will work with pretty much anything you throw at it, and the Google Ai does all the overlays which most of the time looks seamless.
Is there an easier way to go about this without resorting to Retroarch?
https://youtu.be/3JDS4SW0LxQ?si=uyUquDsW1kjj6wzs
Arduino script used for the hotkeys P and O on pins 2 and 3
Code: Select all
#include <Keyboard.h>
const int pPin = 2;
const int oPin = 3;
bool keyPressed = false;
void setup() {
// Set pin 2 and pin 3 as input
pinMode(pPin, INPUT);
pinMode(oPin, INPUT);
// Enable internal pull-up resistor for pin 2 and pin 3
digitalWrite(pPin, HIGH);
digitalWrite(oPin, HIGH);
// Start USB communication
Keyboard.begin();
}
void loop() {
// Check if pin 2 is low
if (digitalRead(pPin) == LOW || digitalRead(oPin) == LOW) {
if (!keyPressed) {
// Press 'p'
Keyboard.press('p');
// Release 'p'
Keyboard.release('p');
delay(50);
// Press 'o'
Keyboard.press('o');
// Release 'o'
Keyboard.release('o');
keyPressed = true;
delay(100); // Delay to avoid repeated keypresses
}
} else {
keyPressed = false;
}
}
