Jump to content

Galaxy AI

From Alfawiki
Galaxy AI
Company typeSoftware platform
IndustryArtificial intelligence, Mobile software
FoundedJanuary 2024; 2 years ago (2024-01)
FounderSamsung Electronics
Headquarters
Suwon
,
South Korea
ProductsAI capabilities for Galaxy mobile devices (language translation, image editing, content discovery)
ParentSamsung Electronics

Galaxy AI represents a suite of artificial intelligence capabilities crafted by Samsung Electronics specifically for Galaxy mobile devices. Introduced alongside the Samsung Galaxy S24 series in January 2024, this platform combines both on-device and cloud computing to enable functionalities such as language translation, image modification, and content discovery. These AI-driven features are embedded within various Samsung apps to streamline everyday user activities.

Overview

Galaxy AI merges Samsung’s proprietary AI frameworks with third-party technologies like Google's Gemini AI to deliver a range of context-aware services. These services encompass language interpretation, media editing tools, and automation of routine tasks, accessible through select Samsung applications.

Features

Galaxy AI offers a variety of tools that leverage artificial intelligence to enhance specific user activities such as communication, note-taking, photography, and productivity. These tools are organized by their purpose and function seamlessly within Samsung’s software ecosystem.

Call Assist

Embedded in the default Phone application on compatible Galaxy devices, this feature provides translation capabilities. It includes Live Translate, which facilitates bidirectional voice and text translation during phone calls, and Text Call, which transcribes spoken words into live text and allows for text-based responses. These functionalities are designed to bridge language barriers and provide alternatives to traditional voice communication.[1][2][3] It is important to note that Text Call does not utilize AI technology and is accessible on all devices running One UI 6.1 or newer.

Writing Assist

Integrated within the Samsung Keyboard, this feature aids users with tasks like translation, sentence construction, and grammar correction. It enhances phrasing, grammar, and tone across supported applications such as messaging and email clients. Additionally, it can generate context-aware suggested replies.[4][5][6]

Interpreter

Available on Galaxy devices operating One UI 6.1 or later versions, this translation tool delivers instantaneous spoken and visual translations for two-way conversations conducted face-to-face. Supporting more than a dozen languages, it features a screen-flip mode allowing each participant to view translations in their native language. Users can also utilize offline functionality by downloading language packs.[7]

Now Brief

Introduced with One UI 7 and further enhanced in One UI 8, the daily summary feature called Now Brief displays scrollable cards containing updates like weather forecasts, calendar appointments, smart home device statuses, and hydration alerts. The update in One UI 8 introduced a “Listen Brief” capability, which utilizes on-device text-to-speech technology. Additionally, Now Brief functions as the visual interface for Gemini Live, presenting AI-generated summaries and suggested follow-ups in card form. These cards dynamically adjust according to the user’s schedule and app interactions, and can be accessed through the Now Bar.

Now Bar

The Now Bar, a customizable toolbar first launched in One UI 7 and refined in One UI 8, provides instant access to live activities, device routines, and app shortcuts. It features real-time widgets such as Now Brief cards and serves as the main platform for launching Gemini Live. A status indicator for Gemini Live (e.g., “listening” or “on hold”) may appear on the lock screen, allowing users to view session status and perform limited controls.

Gemini Live

Part of the Galaxy AI suite and powered by Google Gemini, Gemini Live is a multimodal AI assistant that supports interaction via voice commands, camera input, and screen sharing. Its capabilities include object identification, text translation, and content analysis. Gemini Live integrates seamlessly with compatible apps, especially Samsung’s native applications like Calendar, Samsung Notes, and Reminders. The AI’s responses are often displayed through Now Brief cards, while session monitoring and management are handled through the Now Bar.

Note Assist

Within Samsung Notes, this functionality aids in condensing meeting or lecture content into organized formats. It detects frequently mentioned terms or essential points and arranges them using integrated structuring tools. The resulting summaries can be utilized for review or sharing purposes based on user preferences.

Transcript Assist

Included in the Samsung Voice Recorder application, this feature converts spoken recordings into written text. It also offers supplementary capabilities like simple summarization and translation, contingent on the audio content and system settings. These enhancements aim to streamline audio handling within the app.

Cross-app Action

This capability allows users to perform specific tasks—such as searching, translating, or scheduling events—by selecting text or content across supported applications. It identifies contextual information and displays relevant options within compatible Galaxy and third-party software.

ProVisual Engine

An imaging software solution that leverages scene detection and automatic tuning to enhance image quality on compatible devices. It adjusts factors like color accuracy, luminance, contrast, and noise reduction automatically. Additionally, it provides manual controls for users who desire direct customization.

Nightography

This feature enhances low-light photography by employing noise suppression and exposure adjustments to enable sharper photos and videos in dim environments. Depending on the scene and device specifications, it may also incorporate motion blur minimization.[8][9]

Circle to Search

A search capability activated by gestures that allows users to highlight content on their screen for immediate related web searches. It identifies items such as landmarks, products, and text, delivering search results directly within the app interface to minimize the need for switching applications during contextual inquiries.[7][10]

AI Select

An intelligent suggestion system that evaluates on-screen content to propose relevant user actions. Examples include recommending wallpaper customizations or generating brief video clips from chosen media. This functionality operates within select Samsung applications and its availability may differ based on the device model.[11][12][13][14]

Browsing Assist

Within the Samsung Internet browser, there is a web summarization tool designed to condense lengthy textual content into brief summaries. This feature also supports translation for compatible text but is restricted to processing only text-based data. Its primary purpose is to help users efficiently navigate and comprehend extensive web pages.

Sketch to Image

This image creation tool generates visuals from sketches, photographs, or text prompts by applying algorithm-driven filters to enhance or complete the input. It supports interaction through devices like the S Pen and voice commands. Users can access this functionality within applications such as Samsung Gallery, Samsung Notes, and the Edge Panel.

Portrait Studio

An AI-powered portrait generation feature that transforms photos or sketches into stylized images. It enables users to modify elements like lighting and backgrounds using intuitive touch controls. Available in the Samsung Gallery app, it accommodates input via touch gestures and the S Pen.

Generative Edit

An image manipulation capability enables users to carry out actions such as object removal, background extension, or content resizing by utilizing automated generative tools. This technology algorithmically reconstructs altered sections by analyzing the adjacent visual environment.

Audio Eraser

This post-production tool permits the elimination of background sounds or specific audio components—like voices, wind, or crowd noise—from video recordings. Employing AI-driven audio separation, it isolates and diminishes undesired sound elements. The feature is integrated within the Samsung Gallery app and accessible during video editing sessions.

Auto Trim

A video editing utility that identifies and extracts segments of footage based on visual cues or contextual information. These selected clips can be merged into condensed highlights, minimizing the necessity for manual trimming.

Instant Slo-Mo

A post-processing feature that creates slow-motion effects by inserting additional frames between existing ones. It is activated during video playback in the Gallery app by pressing and holding the screen, without requiring pre-selection of a specific recording mode.

Bixby and Bixby Vision

Within the Galaxy device ecosystem, two input features manage voice and visual recognition capabilities. Bixby interprets verbal commands to control specific functions or access applications, and can be activated either by voice or a dedicated hardware key. Meanwhile, Bixby Vision uses the camera to recognize visual components such as objects or written text, providing relevant information through compatible apps.[15][16][17]

Health Assist

A feature within the Samsung Health application that calculates an Energy score by analyzing elements such as sleep patterns, physical activity, and heart rate variability. This score aims to represent the user’s overall readiness for daily tasks and is compiled from data gathered by various Galaxy devices; however, only smartwatches or smart rings are capable of monitoring sleep.[18][19][20]

Generative Wallpaper and Photo Ambient

These two customization options utilize AI-driven techniques to alter wallpaper visuals. Generative Wallpaper produces images based on keywords or themes supplied by the user, running entirely on the device itself. Conversely, Photo Ambient modifies the wallpaper dynamically according to environmental conditions such as lighting and time of day by applying predefined visual effects.[21][22][23][24]

These functionalities rely on AI executed locally on the device for privacy-sensitive operations, while more demanding processing tasks are handled via cloud-based AI services.[25]

Supported devices

Galaxy AI debuted alongside the Galaxy S24 lineup in January 2024 and has since been rolled out to additional Galaxy models via software upgrades. Compatible devices can access AI capabilities free of charge until the close of 2025, though the range of features differs depending on the device.[26]

Galaxy S series

Galaxy Z series

Galaxy Tab series

Galaxy A series

The Galaxy A series offers limited AI functionalities.

  • Galaxy A56
  • Galaxy A55
  • Galaxy A54
  • Galaxy A36
  • Galaxy A35
  • Galaxy A34

Galaxy Wearables

  • Galaxy Watch7, Watch6 (restricted AI features)
  • Galaxy Buds3, Buds3 Pro (limited AI-enhanced audio processing)

Samsung indicates that further software updates might introduce Galaxy AI compatibility to more devices in the future.[27]

Privacy and ethics

To minimize external data transmission, Galaxy AI primarily handles sensitive information directly on the device, while resorting to cloud computing selectively for tasks requiring substantial processing power. Samsung asserts that user data is neither stored nor utilized for training AI models without explicit consent. Additionally, the company emphasizes its commitment to fairness, transparency, and accountability throughout its AI development process.[28]

  1. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  2. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  3. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  4. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  5. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  6. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  7. ↑ 7.0 7.1 Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  8. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  9. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  10. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  11. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  12. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  13. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  14. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  15. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  16. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  17. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  18. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  19. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  20. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  21. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  22. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  23. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  24. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  25. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  26. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  27. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).
  28. ↑ Lua error in Module:Citation/CS1/Configuration at line 2123: attempt to index field '?' (a nil value).