When Does AI-Powered Personalization Cross the Line?

Carly Buxton

By Carly Buxton

Nov 18, 2026

In a provocative political commercial playing on repeat this election cycle, Virginia Senator Mark Warner holds two grocery bags and, with an expression of extreme dismay, tells viewers that although the bags contain exactly the same items, shoppers might be charged very different prices. 

Pricing in AI-Powered Personalization

Warner’s commercial highlights the shadowy side of AI-powered hyper-personalization, in which companies track your web and in-app behavior to build a portrait of your willingness to pay. 

Businesses can use that information to withhold discounts offered to other customers or tempt you with a deal when you’re feeling particularly spendy. In return, as business writer Christopher Beam notes wryly in The Atlantic, “you get occasional discounts and a free drink on your birthday.”

The Good and Bad of Personalization in Hotels

Personalization has long been the gold standard of luxury hotel service. Remembering a returning guest’s preferences, anticipating a special occasion, or arranging a favorite amenity before arrival are hallmarks of exceptional hospitality. AI offers extraordinary possibilities for delivering that same attentiveness at scale.

But how do we square the tempting possibilities of AI-powered personalization with the darker applications of the same broad technological capabilities? The predictive analytics that help a hotel anticipate a returning guest’s preferences can also be used to infer how much that guest might be willing to pay for a room—or to identify the messages most likely to pressure that traveler into booking.

Knowing our guests and predicting their needs and preferences can be a boon of the AI age in hospitality. But we need to distinguish between collecting information to deliver exceptional service and exploiting that information in ways that would strike our would-be guests as ethically ambiguous.

Four Very Different Uses of Personalization

Part of the problem as we consider the ethics of tech-powered personalization is the word personalization itself. We use the term as though it has one codified meaning, but it doesn’t, and the distinctions matter enormously. 

TypeWhat it looks like in Hospitality & Hotels
Personalized serviceRemembering that a guest prefers a high floor and making sure one is available when she returns. Or knowing that she sleeps with a hot water bottle at night and placing a kettle in her room without her having to ask.
Personalized discoveryRecommending room types, hotel amenities, packages, or local experiences based on a guest’s history and (inferred or explicitly shared) interests.
Personalized persuasionTailoring language, imagery, urgency, and options to make a particular guest more likely to book.
Personalized pricingUsing an individual’s inferred willingness to pay to determine the price or offer that person receives. Important note: this practice, surveillance pricing, is different from the more standard practice of dynamic pricing, in which rates change in response to factors such as demand, inventory, and booking conditions, rather than an individual customer’s inferred willingness to pay.

These four practices of personalization serve different purposes. Some primarily benefit the guest. Others may be designed to extract more value from the guest.

Personalized Persuasion

Personalized persuasion, for example, could be easily couched as service tailoring. Isn’t it wonderful that we’ve shaped this dynamic booking website in a way that speaks to you, a 41-year-old suburban working mom who used to live in Japan? Maybe. 

But if the system has inferred that I’m particularly susceptible to scarcity messaging, it could begin showing me increasingly urgent warnings about rooms selling out—warnings that other guests are not seeing.

How Can the Business and the Guest Benefit?

It’s perfectly reasonable for both the business and the guest to benefit from personalization; it needn’t be an either-or tradeoff. Exceptional service generates loyalty, repeat business, and referrals, which is (of course) good for everyone. 

But a purported consumer benefit doesn’t automatically justify how a business obtains or uses personal information, and we should be especially skeptical when a business uses personal data primarily to increase its own returns at the consumer’s expense. 

Impact of Consent to Data Sharing

It’s easy to get preoccupied with whether consumers have consented to data sharing. Companies emphasize their use of “zero-party data,” or voluntarily shared information and preferences. 

But what does voluntarily shared really mean?
Did the traveler complete a survey explaining what they like?
Did they explicitly tell their travel advisor that they prefer boutique hotels to large resorts?
Or did they toggle an “allow” switch, click “Accept All” on a cookie banner?
Or grant an app access to their digital information just in order to be able to open said app? 

These are very different things.

And as economists Laura Abrardi et al. clarified in their 2024 study of what makes users accept cookies online, making it easy to say yes and difficult to say no to data collection is hardly the same as giving consumers a meaningful choice in how their information is deployed.

Would Your Guest Reasonably Expect You to Use That Information?

So if consent doesn’t necessarily make a use of personal information ethical, and even consumer benefit from personalization is an imperfect measure, how should we decide what’s appropriate when it comes to data collection, sharing, and utilization? Privacy scholar Helen Nissenbaum offers a helpful framework called contextual integrity.

She argues that privacy depends on whether information “flows” between people and organizations in ways appropriate to the relationship and situation. In other words, sharing information isn’t inherently a violation of privacy; what matters is whether that information moves within or across boundaries as you would expect when sharing it.

One Piece of Information, Three Very Different Uses

Imagine, for example, that you tell a luxury hotel you’re celebrating your anniversary.

  • Scenario 1: The concierge arranges champagne in your room. A+ personalization.
  • Scenario 2: The hotel shares that information with its restaurant, which prepares a special dessert when you dine there. Probably also great.
  • Scenario 3: The hotel sells that information to unrelated advertisers, who begin targeting you with romantic getaway packages. This feels sneaky.

It’s the same information, but with three different applications. Even if the guest originally consented to sharing the information, that doesn’t necessarily make every subsequent use appropriate. The crux of the ethical question is whether the subsequent use of that information is consistent with the relationship the guest believes they have with the business.

How Hotel Operators Can Evaluate Their Personalization Practices

Inspired by Nissenbaum’s framework, here are four questions hotel operators can use to evaluate their personalization practices:

1. Why Did the Hotel Guest Share This Information?

First, prioritize the guest’s intent when entrusting us with personal information. Review how information collected through booking forms, guest profiles, and concierge interactions is subsequently used in marketing campaigns and customer experience. Does that use align with the guest’s original intent for sharing that information?

2. Are We Serving the Hotel Guest or Steering the Guest?

Second, help guests accomplish their own goals rather than steering them toward decisions that primarily serve ours. Audit personalized website content, booking prompts, and automated offers. Are they helping all guests find what they’re looking for, or exploiting individual guests’ susceptibility to urgency, scarcity, or other persuasive tactics?

3. Could We Explain This Practice to the Guest?

Ask yourself: could we comfortably explain our use of that information to the guest? Before launching an AI-powered guest communication campaign or recommendation engine, ask the team to explain how guest information determines who receives which messages and offers. Would you be comfortable sharing that explanation with the guests themselves? 

4. Have We Defined Our Ethical Boundaries?

Lastly, codify in plain language your company’s ethical stance on sharing customer data with AI tools. Companies like Signature Travel Network and Fora are touting their sophisticated AI-powered systems that help travel advisors recommend just the right destination, hotel, or itinerary at just the right time. These are exciting developments, but the industry’s ability to realize their potential depends on maintaining travelers’ trust. One splashy, public ethical misstep by a key player could cast suspicion on the entire category of AI-powered personalization.

Protect yourself by drafting a user-friendly manifesto that draws clear lines on data sharing and use—not the legalese of a privacy policy or the jargon of your terms and conditions, but a unified team approach to the ethical limits you’re imposing upon your AI’s capabilities.

After all, the whole point of knowing your guest is to make their experience better. We should be careful that the extraordinary new ability to predict what people will do doesn’t tempt us to forget whom we’re supposed to be serving.

About the author

Carly Buxton

Carly Buxton provides fractional product management for hospitality and travel tech companies and advises hotels on software and AI implementation.

For technology companies, Carly works alongside founders and product teams to understand customer needs, decide which problems to tackle, and turn those decisions into a product roadmap. She brings a founder’s perspective and a background in customer research to the work.

For hotels, Carly helps operators identify where software and AI can improve day-to-day operations and the guest experience. She helps teams evaluate tools and plan how to introduce them into existing workflows, with particular attention to how changes affect staff and guest communication.

Carly is a member of Cayuga Hospitality Consultants.


Contact Us
Share

Related Articles & Case Studies

Gary Isenberg
Case Study
Hotels
Litigation, Risk Management & Insurance

Expert Witness Case Study: Hotel Business Interruption & Financial Damages

By Gary Isenberg Oct 14, 2026

Understanding Hotel Business Interruption Losses: Why Lost Revenue Is Not the Same as Lost Damages One of the most common misconceptions in...

Read More
Daphne Gezen
Development & Acquisitions
Hotels

From Runways to Residences: The Evolution of Branded Residences, Opportunities and Challenges

By Daphne Gezen Oct 7, 2026

Branded residences which are the residential properties that combine private ownership with hotel-quality services and amenities, typically associated with established hospitality or...

Read More
Brian Schoettes
Hotels
Operations & Management

Hotel-Level Workforce Management: Reducing Wage Spend, Improving Guest Service and Reflecting Priorities

By Brian Schoettes Oct 2, 2026

While everyone knows the schedule is important and is viewed as the lifeblood of hotel operations, most hotels have little structure and...

Read More

Enquire Now

Trusted By