D3D11 HW Acceleration (2024/12/18)
Overview
Implemented hardware-accelerated video decoding using Direct3D 11 (D3D11) to improve performance and reduce CPU load. This enhancement allows smoother video playback and better resource utilization, particularly on Windows devices. Comparison: Hardware vs. Software Decoding
The comparison highlights the significant reduction in latency when using hardware decoding. Specifically:
Software Decoder: Latency is approximately 40-80ms, which can result in noticeable delays and reduced playback smoothness. Hardware Decoder (D3D11): Achieves an average latency of 20-40ms, providing a much smoother and more responsive experience. Changes Made
Integrated D3D11 video decoder into the existing rendering pipeline. Updated dependency configurations to support Direct3D 11. Modified rendering logic to leverage hardware acceleration where available. Added fallback mechanisms for unsupported hardware. Benefits
Reduced CPU usage during video playback. Enhanced video rendering performance and efficiency. Improved user experience with smoother video playback. Known Issues
Certain older GPUs may not fully support D3D11 decoding. Possible compatibility issues with non-Windows platforms requiring additional adjustments. Upgraded SDL2 to SDL3 (2025/01/12)
Overview
Upgraded from SDL2 to SDL3 to leverage the latest features and improvements. Enhanced performance, stability, and cross-platform support. Our app is now compatible with additional platforms, including iOS, macOS, tvOS, Xbox, and PlayStation. Plan to add VideoToolBox hardware acceleration for supported Apple platforms. SDL3 now allows using SDL Audio as a universal audio driver across all platforms. SDL Renderer can be used as a universal video renderer, making the app compatible with Windows, iOS, Android, macOS, Linux, Xbox, and PlayStation.
After many tries, it worked on iOS!😅
Changes Made
Updated build configurations to support SDL3. Refactored code to accommodate new SDL3 API changes. Removed deprecated SDL2 functions and replaced them with SDL3 equivalents. Benefits
Improved rendering performance and efficiency. Better multi-threading support and resource management. Enhanced compatibility with modern platforms and hardware. Unified audio and video rendering across multiple platforms. Next Steps
Further optimize SDL3 implementation for additional performance gains. Integrate VideoToolBox for Apple platforms. Monitor feedback and address any compatibility issues. Known Issues
Minor compatibility issues with older plugins relying on SDL2. Potential adjustments needed for platform-specific optimizations. Windows Client Update (2025/02/04)
Overview
Released a new version of the Windows CLI client with improved performance and stability. Optimized execution speed and reduced memory usage. Improved error handling and logging for better debugging and monitoring. Changes Made
Refactored core logic for efficiency and responsiveness. Enhanced integration with Windows APIs for optimized system performance. Fixed known issues related to path handling and environment detection. Benefits
Faster execution and lower resource consumption. Better error reporting and logging for troubleshooting. Improved compatibility with Windows 10 and Windows 11. More reliable handling of file operations and network requests. Next Steps
Further optimize performance for low-end Windows devices. Known Issues
Some third-party integrations may require additional configuration adjustments. Room-Base Game Sessions(2025/03/16)
Overview
Users can create a game room and invite up to 3 friends to join. Everyone shares the same screen, hears the same sounds, and can connect their own gamepads to play together — just like sharing a gaming console over the internet.
Implemented room-based game sessions allowing users to share their game session with up to 4 players, based on their subscription tier. Users can now send messages within their game session, enhancing social interaction during gameplay. Changes Made
Created a new room system to manage game sessions. Integrated messaging functionality within game sessions for real-time communication. Added logic to enforce player limits based on the user's subscription tier. Updated user interface to reflect the new features and allow easy management of game rooms. Benefits
Enhanced multiplayer experience with the ability to share sessions and communicate with others. Improved social interaction during gameplay. Tailored experience based on user subscription tiers. Next Steps
Optimize the room system for larger sessions in future updates. Enhance message delivery with push notifications for important in-game messages. Known Issues
Limited support for session transitions when a player joins mid-session. Potential issues with messaging synchronization across different devices. Authorization During Deeplink (2025/04/12)
Overview
Added authorization support for deeplinks across multiple platforms to ensure secure access to game sessions and features. Users are now required to authenticate when accessing the app through deeplinks, providing a more secure experience. Changes made
Integrated authentication flow during deeplink handling to verify user identity. Updated platform-specific implementations (iOS, Android, Windows) to handle deeplink authorization consistently. Added fallback mechanisms for users who are not authenticated. Benefits
Improved security by ensuring only authorized users can access game sessions through deeplinks. Streamlined user experience across different platforms. Increased control over access to sensitive game session features. Next Steps
Implemented device code authorization for TV apps to provide a more secure and user-friendly authentication method. (Like Netflix TV). First Look at the Prototype (2025/05/18)
Overview
This prototype offers a first look at the main page of our app, hinting at the direction we’re heading for the MVP. It’s a glimpse into the simple, hardware-accelerated UI design we’re aiming for, with a focus on intuitive navigation and a clean user experience.
Changes Made
Early implementation of core UI elements. Initial layout for the main app structure. Benefits
Smooth, low-latency interactions. Clear, user-friendly design for easy access to features. Flexible architecture, ready for further expansion. Next Steps
Refine the UI to match the final product vision. Optimize for faster load times and improved responsiveness. CDN Integration (2025/06/25)
overview
This update introduces a scalable CDN system for hosting and delivering game content using MinIO, an S3-compatible storage backend. Since we're running a self-hosted Supabase instance, MinIO is a natural choice — offering full control over our data and aligning with our decentralized infrastructure strategy. It also includes a semi-complete version of the game details page and important fixes from Month-2.
Changes Made
Configured MinIO buckets and integrated signed URL access. Updated frontend to load all media content from MinIO. Implemented key parts of the game details UI. Completed Month-3 backlog items. Benefits
No reliance on third-party cloud providers (more secure, private, and cost-effective) A more complete and visually informative game page. Next Steps
Begin development of the “Destination” streaming page, where users will launch and control their cloud gaming sessions. Artifacts
*Macs with Apple Silicon chips can also run the iOS TestFlight app.
# For security reasons, after installing the macOS test app, run the following command:
xattr -d com.apple.quarantine /Applications/CloudPlay.app
# Or go to System Settings > Security & Privacy > Security > Open Anyway
Virtual Game Controller UI (2025/07/29)
overview
We’ve brought back and modernized the virtual game controller from the earlier CloudPlay Android app, now fully re-engineered using NanoVG cross-platform vector graphics engine.
This new version isn’t just a clone, it’s a lightweight, hardware-accelerated controller. Built for precision and responsiveness, it's a key part of delivering full-featured gameplay without needing a physical controller.
Changes Made
Ported and redesigned the original CloudPlay Android gamepad for the new platform. Rebuilt UI entirely in NanoVG for GPU-accelerated vector rendering. Implemented analog-style joystick with smooth touch tracking. Added dynamic layout scaling to support different devices and screen sizes. Benefits
Clean visual design with flexible layout system. Touch input feels natural and low-latency, even on slower devices. Platform-independent - runs on any device that supports pan gestures Next Steps
Add haptic feedback for supported touch devices. Expose layout and skin customization options. Add gesture shortcuts (e.g. swipe to pause or open menu). Queue Connection & Remote PC on iOS (2025/07/29)
Overview
This prototype demonstrates the initial implementation of the queue connection flow and remote PC session on iOS, using a local test server and a remote PC on the same local network. It’s an essential step in validating the end-to-end mechanics of CloudPlay’s queue system and remote session handling.
While this version runs entirely on a test environment, the core architecture is being designed with scalability in mind, with plans to transition to cloud GPU servers for real remote streaming.
Changes Made
Developed the Queue Server backend, managing seat reservations and reconnect windows. Integrated queue status and session initiation UI on iOS. Connected to a local remote PC for streaming via local network. Implemented basic session transition animations to emulate production flow. Benefits
Foundation of the queueing mechanism and remote session transition is in place. Testing and iterating in a controlled local environment ensures a stable core. Early-stage optimization of Metal-based rendering pipeline for iOS. Next Steps
Transition to cloud GPU streaming using GPU instances. Research alternative cloud GPU providers that allow virtual workstations (not just AI workloads). Add network resiliency features for handling unstable connections in cloud environments. Product Key Redemption (2025/08/28)
Overview
This update introduces a Product Key redemption system for beta users. With this feature, testers can now redeem keys to unlock access to streaming demos, making it possible to validate features with a controlled group before wider rollout.
Changes Made
Added Product Key input and validation flow in the client app. Integrated key redemption with Supabase authentication. Enabled streaming demo unlocks for beta testers after key activation. UI improvements: streamlined redemption dialog with error handling and success confirmation. Benefits
Provides a controlled entry point for beta access. Reduces friction for testers by allowing instant unlock of demo streaming. Scalable — can support different product tiers (Beta, Early Access, Premium) in the future. More secure than manual account flagging, since keys are validated server-side. Virtual Keyboard (2025/09/12)
The new Virtual Keyboard is now available across supported platforms with touch gesture capabilities. This update brings a native, configurable typing experience directly inside app, making it easier to interact during gameplay without relying on external hardware.
Changes Made
Implemented virtual keyboard module for all touch-capable devices. Added gesture-based activation (configurable in settings): Three-finger tap → Open keyboard Four-finger tap → Open keyboard Five-finger tap → Open keyboard Integrated in-game overlay toggle for quick keyboard access. New settings options to adjust gesture preferences and keyboard layout. In-Game Overlay (2025/09/20)
For touch-enabled devices, users can now slide from left to right on the screen to summon the overlay. On devices with a connected gamepad, a configurable button combo can be used instead.
Changes Made
Swipe left → right across the screen to open overlay. Works only when no physical controller is connected. Overlay open can be triggered by a configurable button combo. Default combo provided; customization available in Settings → Controls. Added new options to configure overlay summon method. Separate preferences for touch gestures and gamepad combos. Profile Completion (2025/10/17)
This update introduces a new Profile Completion screen designed to personalize in-app experiences and improve content recommendations. By collecting basic user details such as full name, email, and age, the app can now tailor game suggestions and promotional content to better match player preferences.