4

我有一个如下表：

WITH
  table1 AS (
  SELECT
    TIMESTAMP '2016-10-18 2:51:45' AS ts,
    'AB4' AS packId,
    FALSE AS stat,
    'x' AS position
  UNION ALL
  SELECT
    TIMESTAMP '2016-10-18 2:54:11',
    'AB4',
    FALSE,
    'x'
  UNION ALL
  SELECT
    TIMESTAMP '2016-10-18 3:01:17',
    'AB4',
    FALSE,
    'x'
  UNION ALL
  SELECT
    TIMESTAMP '2016-10-18 3:05:42',
    'AB4',
    TRUE,
    NULL
  UNION ALL
  SELECT
    TIMESTAMP '2016-10-18 3:06:24',
    'AB4',
    FALSE,
    'x'
  UNION ALL
  SELECT
    TIMESTAMP '2016-10-18 3:06:36',
    'AB4',
    TRUE,
    'y'
  UNION ALL
  SELECT
    TIMESTAMP '2016-10-18 3:07:41',
    'AB4',
    FALSE,
    'x')
SELECT
  ts,
  packId,
  stat,
  position,
  LAG(position) OVER prev_pos AS previous_position1,
  LAG(position,2) OVER prev_pos AS previous_position2
FROM
  table1
WINDOW
  prev_pos AS (
  PARTITION BY
    packId
  ORDER BY
    ts)

结果如下所示：

在此处输入图像描述

我想获得不为 null 的前一个值（从列位置），如结果表所示，我希望这些空值是前一个非空值，在本例中它们都是“x”。（有数千行具有空位置，因此当前行的最后一个非空位置可能是它之前的一千行）

总结：如何在 bigquery 中忽略 Lag 的空值？

4

2 回答 2

5

以下是 BigQuery 标准 SQL

WITH table1 AS (
  SELECT TIMESTAMP '2016-10-18 2:51:45' AS ts, 'AB4' AS packId, FALSE AS stat, 'x3' AS position UNION ALL
  SELECT TIMESTAMP '2016-10-18 2:54:11', 'AB4', FALSE, 'x2' UNION ALL
  SELECT TIMESTAMP '2016-10-18 3:01:17', 'AB4', FALSE, 'x1' UNION ALL
  SELECT TIMESTAMP '2016-10-18 3:05:42', 'AB4', TRUE, NULL UNION ALL
  SELECT TIMESTAMP '2016-10-18 3:06:24', 'AB4', FALSE, 'x' UNION ALL
  SELECT TIMESTAMP '2016-10-18 3:06:36', 'AB4', TRUE, 'y' UNION ALL
  SELECT TIMESTAMP '2016-10-18 3:07:41', 'AB4', FALSE, 'x'
)
SELECT
  ts,
  packId,
  stat,
  position,
  NTH_VALUE(position, 1 IGNORE NULLS) OVER prev_pos AS previous_position1,
  NTH_VALUE(position, 2 IGNORE NULLS) OVER prev_pos AS previous_position2
FROM  table1
WINDOW prev_pos AS 
  (PARTITION BY packId ORDER BY ts DESC ROWS BETWEEN 1 FOLLOWING and UNBOUNDED FOLLOWING)
-- ORDER BY ts

带输出

在此处输入图像描述

如您所见，不需要子查询 - 对原始查询的唯一更改是

  1. 分别替换LAG(position)和LAG(position,2)-NTH_VALUE(position, 1 IGNORE NULLS)和NTH_VALUE(position, 2 IGNORE NULLS)

  2. prev_pos向窗口添加适当的框架子句

于 2020-12-30T18:37:50.403 回答
1

BigQuery 使这有点困难。一种方法是枚举具有位置值的组。然后使用窗口框架规范从前一个组和之前的组中获取值。

诀窍是分配组。最简单的方法是对每行上或之后的非 NULL 值进行计数。这将为每一行分配一个NULL值给下一个组。但是，组号是相反的顺序。

这是结果查询：

SELECT t1.*,
       MAX(position) OVER (PARTITION BY packId ORDER BY grp DESC RANGE BETWEEN 1 preceding and 1 preceding) as prev1,
       MAX(position) OVER (PARTITION BY packId ORDER BY grp DESC RANGE BETWEEN 2 preceding and 2 preceding) as prev2,
FROM (SELECT t1.*,
             COUNT(position) OVER (PARTITION BY packid ORDER BY ts DESC) as grp
      FROM table1 t1 
     ) t1
于 2020-12-30T12:54:08.220 回答