In a major update for Android and iPhone users this year, artificial intelligence (AI) will dominate smartphone functionalities, largely driven by Google. However, this advancement comes with a serious warning regarding user security and privacy, requiring a change in how we use our phones.

The integration of generative AI into commonly used smartphone apps is expected to surpass last year's adoption of ChatGPT technology. The convenience and helpfulness of AI chatbots might lead users to overlook privacy concerns that could arise from engaging in conversations with them, mistakenly treating them as trusted friends in private chats.

While individuals may exercise caution while installing apps, granting permissions, or sharing data with companies like Facebook and Google, interacting with AI chatbots seems to create a blind spot. Recognizing this potential risk, Google has issued a warning to all Android and iPhone users to exercise extreme care when using these new technologies.

Google advises users to avoid entering confidential information or any data they would not want reviewers or Google itself to access and utilize for product improvement purposes. The company acknowledges that it collects conversations from Gemini Apps, along with related product usage information, location data, and user feedback. This data is used to enhance Google products, services, and machine learning technologies.

Thankfully, Google assures users that Gemini Apps conversations are not currently used for targeted advertising. However, the company adds that if this policy changes in the future, users will be clearly informed. The risk lies in users oversharing sensitive information with AI chatbots, particularly when discussing business plans, sales presentations, or even academic dishonesty.

It is essential to note that conversations and information shared with AI chatbots are not only recorded but also potentially susceptible to leaks. Even when ending a chat, the questions asked and the answers received remain part of a stored record that can be retrieved and reviewed.

Moreover, the concerns extend beyond standalone apps, as integration and usage of Gemini Apps with other Google services may involve the collection and utilization of user data in accordance with each service's privacy policies.

The risks associated with generative AI are only just beginning to be understood. For instance, Google Gemini (previously known as Bard) may request access to review past private messages to shape context and content for its suggestions, potentially breaching end-to-end encryption within messaging apps.

One of the critical issues is off-device storage, with Google clarifying that data will be stored "by default" for up to 18 months. Users have the option to modify this duration to either three or 36 months in their Gemini Apps Activity settings. Additionally, location information, including general areas, IP addresses, or home and work addresses stored in Google Accounts, is also associated with Gemini Apps activity.

This privacy concern is not exclusive to Google, as the data collection and usage practices observed are typical within the emerging generative AI industry. Differentiating between the security and privacy measures of Google and other companies in this space will be a pivotal factor for users in the future.

Jake Moore, an expert from ESET, emphasizes that any data shared online, even through private channels, holds the potential to be stored, analyzed, and potentially shared with third parties. Users may be unaware of the risks posed by AI models designed to extract vast amounts of personal information, creating security and privacy issues.

Fortunately, Google offers the option to disable long-term data collection in Gemini by adjusting the settings. Disabling this feature ensures that future conversations are not sent for human review or used to improve generative machine-learning models. Users can also delete chats, and although related activity will be saved for up to 72 hours to provide the service, it will not be displayed in Gemini Apps Activity.

The growing divide in AI analysis between on-device and off-device processing will significantly influence this new generation of smartphone functionalities. While Apple is expected to prioritize on-device analysis through its own apps, Google's focus on cloud-based processing will lead to more extensive use of off-device capabilities.

Android and iPhone users with Gemini-powered apps now face challenging choices. As this technology becomes more widespread, users must decide whether to prioritize privacy and the progress made in protecting browsing habits, tracking, and location sharing or embrace the convenience and advancements offered by AI integration in mainstream apps.

In the rapidly evolving landscape of AI technology, user awareness of the potential risks and the responsibility of companies to communicate and prioritize user privacy will shape the future of mobile experiences.