☕[AT Community Q&A Coffee Break] WEDNESDAY 12/6/23, 8am PT: Machine Learning & AI Reporting & Analysis w/ Brent Kostak, Cristinel Anastasoaie, & Drew Burns of the Adobe Target Product Team ☕ | Community
Skip to main content
Amelia_Waliany
Employee
November 30, 2023

☕[AT Community Q&A Coffee Break] WEDNESDAY 12/6/23, 8am PT: Machine Learning & AI Reporting & Analysis w/ Brent Kostak, Cristinel Anastasoaie, & Drew Burns of the Adobe Target Product Team ☕

  • November 30, 2023
  • 15 replies
  • 10992 views

Join us for the next Adobe Target Community Q&A Coffee Break! 

  Wednesday, December 6th from 8am - 9am PT 

We'll be joined by Adobe Target experts: Brent Kostak (@bkostak), Cristinel Anastasoaie (@cristinel), and Drew Burns (@drewb6915421). In this AMA (Ask Me Anything)- like event, the experts will be logged in to chat with you over this Discussion Thread, ready to answer your any of your questions. Marisol St. John () of the Target Technical Support Engineering team will also be joining for extra support. This discussion is geared toward customers who find themselves aligning with the following Target topics:

 

Participating is easy:

  • Register by RSVPing on the right hand side button with 'Yes', 'No', or 'Maybe', as applicable and click "Add to Calendar".
  • Add your Questions below leading up to and on the day of the Coffee Break event and be sure to begin your Question with our hosts' Community Usernames: @bkostak@cristinel), and @drewb6915421
  • Stand-by to reply and engage on the page as the experts weigh in during the hour, so that you can:
    • Clarify your questions
    • Ask follow up Qs and provide additional details
    • See Questions posted by other Community members to up-vote those that you find interesting
    • Discuss further with your Target Community member peers 

Meet the experts:

 

 

As Product Marketing Manager at Adobe, Brent brings data-driven personalization solutions to market that connect global brands to their customers. Adobe enables enterprise marketing and engineering teams to streamline data and create a single, personalized view of their customers to deliver exceptional digital experiences. Brent has over 10 years of experience helping organizations leverage software technologies and services to better compete and serve their mission.

 

 

Cristinel is a Senior Product Manager for Adobe Target, focused on machine learning personalization in Adobe Target, Analytics for Target integration, and the product user interface. Before his current Adobe role, Cristinel held product management positions on various content management and digital marketing products focused on consumers.

 

Drew Burns is Group Product Marketing Manager for Adobe Target, the industry-leading experience optimization platform, and he has been an evangelist and a practitioner in the personalization and testing space for 15 years.  He works with progressive enterprise companies across industries on building the foundation and maturing their optimization and personalization efforts, strategies and programs leveraging manual and A.I./ML capabilities. At Adobe, he works alongside the leading enterprise companies in retail/e-commerce, travel & hospitality, financial, media & publishing, B2B/ High Tech and other verticals to improve and grow their optimization and personalization efforts, strategies and programs. 

 

 

💡 Something already coming to mind?💡

Add your related questions below any time before or during the Coffee Break on Wednesday, December 6th, when you can watch the page and be ready to add follow-up questions and discuss further with other community members!

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

15 replies

New Participant
December 6, 2023

Hello, curious to hear what people's experience is while running A/A Tests. We periodically run A/A tests (~bi-annual) on our site to confirm that our tracking is as expected. However, we've noticed that our past 3 A/A tests over a month have had inconsistent results with lifts in overall page engagement reported anywhere from 8-20% for the first 1-2 weeks before results stabilize. Would love to hear what other practitioners experience

Employee
December 6, 2023

@officialyi Adobe Target uses a Students t-test method which is optimal for multiple variants, especially if those variants perform similarly within a test, but does require waiting until 95% confidence is reached to provide rigorous, accurate results while reducing the incidence of false positives.  You may want to run an A/A test utilizing Auto-Allocate which allows for "peeking" during the course of the activity for relative lift/confidence with accuracy at any point during the activity when testing 2 variants. 

Employee
December 6, 2023

@Officialyi Is this an A4t test or Adobe Target for Analytics?

bkostak
Employee
December 6, 2023

Welcome community members and Target experts! Looking forward to the session to answer all AI/ML questions from those joining today. Great topics we've been hearing from the community from recent Adobe Insider Tour events. Excited for this one! 

Employee
December 6, 2023

Hi everyone! Exciting to be here, Welcome!

New Participant
December 6, 2023

@bkostak@cristinel), and @Drburns27 For Automated Personalization, because I cannot use AA as the reporting source, I am limited in metrics that I want to track. Is there a way to track Bounce Rate in Target Reporting for Automated Personalization?

Employee
December 6, 2023

@madisondicken You may want to try setting up the activity, depending on the use case, leveraging Auto-Target which is built into the A/B testing workflow, and uses the same Random Forest Ensemble set of algorithms as Automated Personalization for 1:1 Personalization and does support A4T, which can report on bounce rate as well as any other metric you wish to track.  Keeping the variants low is optimal for these AI-powered personalization activities but multiple activities can be run concurrently for greater efficiency.

Employee
December 6, 2023

Hi everyone!  We're thrilled to be bringing you another Coffee Break in the series on AI-powered testing and personalization.  Please input your questions and we'll try to answer as many as we can during the session, and follow up after with any we may not have been able to answer within the timeframe!

New Participant
December 6, 2023

Auto-Target Reporting Issue - Where are my Important Attributes and Automated Segment Reports

Hello,

Looking for some support/insight from anyone that has utilized the Auto-Target feature within an A/B test. My test has been running for quite some time and I've reached the necessarily visitors and conversions levels needed for my algorithms to begin learning, 1,000 visits and 50 conversions (7,000 overall visits and 350 overall conversions) as I understand them. However, my reporting is still stating that the models have not been built yet - as indicated by the clock icon still next to my experiences. I'm also not seeing the Important Attributes report nor the Automated segment reports that are supposed to come along with this tool....presumably because the models are still being indicated as not finalize yet? I am using a Conversion goal, 'clicked an element' for our goal metric. 

This test has been running for over 100 days and it seems to be collecting the right information, but no models and no reports yet, any ideas? Are the experiences just too similar for the AI to pick up anything and create a model from? Appreciate any thoughts or comments!

 

 

Employee
December 6, 2023

@benmu6 This is a strange issue that I have not come across before and hard to diagnose without a review of the activity itself.  Have you referred to Analytics for your reporting (Analysis Workspace)?  Please open a ticket with Support so they can review the activity and provide guidance on where there may be issues.