sql—在mysql窗口函数中从第一行、最后一行和聚合中获取值

n1bvdmb6  于 2021-07-26  发布在  Java
关注(0)|答案(2)|浏览(385)

对于市场营销相关的分析,我需要提供关于第一个和最后一个接触点的数据以及与我们网站的总互动次数。
简化版的 interaction 表如下所示:

  1. create table interaction (
  2. id varchar(36) primary key,
  3. session_id varchar(36) not null,
  4. timestamp timestamp(3) not null,
  5. utm_source varchar(255) null,
  6. utm_medium varchar(255) null
  7. )

我们目前的做法如下:

  1. with interaction_ordered as (
  2. select *,
  3. row_number() over (partition by session_id order by timestamp asc) as row_num_asc,
  4. row_number() over (partition by session_id order by timestamp desc) as row_num_desc
  5. from interaction
  6. )
  7. select first_interaction.session_id as session_id,
  8. first_interaction.timestamp as session_start,
  9. timestampdiff(SECOND, first_interaction.timestamp, last_interaction.timestamp) as session_duration,
  10. count(*) as interaction_count,
  11. first_interaction.utm_source as first_touchpoint,
  12. last_interaction.utm_source as last_touchpoint,
  13. last_interaction.utm_medium as last_medium
  14. from interaction_ordered as interaction
  15. join interaction_ordered as first_interaction using (session_id)
  16. join interaction_ordered as last_interaction using (session_id)
  17. where first_interaction.row_num_asc = 1 and last_interaction.row_num_desc = 1
  18. group by session_id
  19. having session_start between ? - interval 1 day and ? + interval 1 day

目前,我们观察到运行时与我们的数据近似线性,这将很快变得不可行。
另一个想法是

  1. select session_id,
  2. min(timestamp) as session_start,
  3. timestampdiff(
  4. SECOND,
  5. min(timestamp),
  6. max(timestamp)
  7. ) as session_duration,
  8. count(*) as interaction_count,
  9. first_value(utm_source) over (partition by session_id order by timestamp) as first_touchpoint,
  10. first_value(utm_source) over (partition by session_id order by timestamp desc) as last_touchpoint,
  11. first_value(utm_medium) over (partition by session_id order by timestamp desc) as last_medium
  12. from interaction
  13. group by session_id
  14. having session_start between ? - interval 1 day and ? + interval 1 day

但在我们的实验中,我们从未看到第二个查询完成。因此,我们不能100%肯定它会产生相同的结果。
我们试过了 timestamp 以及 (session_id, timestamp) ,但根据 EXPLAIN 这并没有改变查询计划。
有没有快速的方法从每个会话id的第一个和最后一个条目加上每个会话id的计数中检索单个属性?请注意,在我们的实际示例中,有更多类似于 utm_source 以及 utm_medium 我们感兴趣的。
编辑
样本数据:

  1. insert into interaction values
  2. ('a', 'session_1', '2020-06-15T12:00:00.000', 'search.com', 'search'),
  3. ('b', 'session_1', '2020-06-15T12:01:00.000', null, null),
  4. ('c', 'session_1', '2020-06-15T12:01:30.000', 'social.com', 'social'),
  5. ('d', 'session_1', '2020-06-15T12:02:00.250', 'ads.com', 'ads'),
  6. ('e', 'session_2', '2020-06-15T14:00:00.000', null, null),
  7. ('f', 'session_2', '2020-06-15T14:12:00.000', null, null),
  8. ('g', 'session_2', '2020-06-15T14:25:00.000', 'social.com', 'social'),
  9. ('h', 'session_3', '2020-06-16T12:05:00.000', 'ads.com', 'ads'),
  10. ('i', 'session_3', '2020-06-16T12:05:01.000', null, null),
  11. ('j', 'session_4', '2020-06-15T12:00:00.000', null, null),
  12. ('k', 'session_5', '2020-06-15T12:00:00.000', 'search.com', 'search');

预期结果:

  1. session_id, session_start, session_duration, interaction_count, first_touchpoint, last_touchpoint, last_medium
  2. session_1, 2020-06-15T12:00:00.000, 120, 4, search.com, ads.com, ads
  3. session_2, 2020-06-15T14:00:00.000, 1500, 3, null, social.com, social
  4. session_3, 2020-06-16T12:05:00.000, 1, 2, ads.com, null, null
  5. session_4, 2020-06-15T12:00:00.000, 0, 1, null, null, null
  6. session_5, 2020-06-15T12:00:00.000, 0, 1, search.com, search.com, search

我注意到我的第二个查询没有产生预期的结果。这个 last_touchpoint 以及 last_medium 而是用第一个值填充。我试过了 first_value(utm_source) over (partition by session_id order by timestamp desc) as last_touchpoint, 以及 last_value(utm_source) over (partition by session_id order by timestamp range between unbounded preceding and unbounded following) as last_touchpoint,

ih99xse1

ih99xse11#

使查询可伸缩的唯一方法是使用 where 条款。如果我假设会话的持续时间不会超过一天,那么我可以将计算的时间范围扩展一天,并使用窗口函数。结果是这样的:

  1. select s.*
  2. from (select i.*,
  3. min(timestamp) over (partition by session_id) as session_start,
  4. count(*) over (partition by session_id) as interaction_count,
  5. first_value(utm_source) over (partition by session_id order by timestamp) as first_touchpoint,
  6. first_value(utm_source) over (partition by session_id order by timestamp desc) as last_touchpoint,
  7. first_value(utm_medium) over (partition by session_id order by timestamp desc) as last_medium
  8. from interaction i
  9. where timestamp between ? - interval 2 day and ? + interval 2 day
  10. ) s
  11. where timestamp = session_start and
  12. session_start between ? - interval 1 day and ? + interval 1 day;

你使用 first_value() 应该返回一个错误——它违反了mysql 8+默认设置的“full group by”规则。语法错误的代码不起作用也就不足为奇了。

bqjvbblv

bqjvbblv2#

  1. WITH cte AS ( SELECT *,
  2. FIRST_VALUE(utm_source) OVER (PARTITION BY session_id ORDER BY `timestamp` ASC) first_touchpoint,
  3. FIRST_VALUE(utm_source) OVER (PARTITION BY session_id ORDER BY `timestamp` DESC) last_touchpoint,
  4. FIRST_VALUE(utm_medium) OVER (PARTITION BY session_id ORDER BY `timestamp` DESC) last_medium
  5. FROM interaction
  6. )
  7. SELECT session_id,
  8. MIN(`timestamp`) session_start,
  9. TIMESTAMPDIFF(SECOND, MIN(`timestamp`), MAX(`timestamp`)) session_duration,
  10. COUNT(*) interaction_count,
  11. ANY_VALUE( first_touchpoint ) first_touchpoint,
  12. ANY_VALUE( last_touchpoint ) last_touchpoint,
  13. ANY_VALUE( last_medium ) last_medium
  14. FROM cte
  15. GROUP BY session_id;

小提琴

相关问题