★ wanayoo — archive 1999 https://github.com/nodejs/node/pull/31936Nouvelle recherche | Portail wanayoo
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: mark empty udp tests flaky on OS X #31936

Closed
wants to merge 1 commit into from

Conversation

Copy link
Contributor

@sam-github sam-github commented Feb 24, 2020

They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X.

Refs: #30030
Refs: nodejs/build#2189 (comment)

Note: CI doesn't test on Catalina, yet (though I assume nodejs developers do). Test failures will indirectly block fixing of #29216, which requires running notarization on Catalina, which requires tests passing on Catalina.

Checklist
  • make -j4 test (UNIX), or vcbuild test (Windows) passes
  • tests and/or benchmarks are included
  • documentation is changed or added
  • commit message follows commit guidelines

They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X.

Refs: nodejs#30030
Refs: nodejs/build#2189 (comment)
@nodejs-github-bot nodejs-github-bot added the test label Feb 24, 2020
@sam-github sam-github added lts-watch-v10.x lts-watch-v12.x labels Feb 24, 2020
@sam-github sam-github added the flaky-test label Feb 24, 2020
@sam-github
Copy link
Contributor Author

@sam-github sam-github commented Feb 24, 2020

I don't have access to a machine I can repro this on, but I asked @AshCripps to try it (nodejs/build#2189 (comment)). @lpinca , perhaps you can review, too?

@sam-github sam-github requested a review from lpinca Feb 24, 2020
@lpinca
Copy link
Member

@lpinca lpinca commented Feb 24, 2020

I've run make -j8 test with the patch applied but the process still exits with 2 not sure if expected. All the tested listed here timeout as expected.

Copy link
Member

@AshCripps AshCripps left a comment

Works for me. @lpinca you have to run the tests manually using the python script to skip flaky-tests like the ci does:

bash-3.2$ tools/test.py --flaky-tests=skip
[07:30|% 100|+ 2790|-   0]: Done
bash-3.2$

@lpinca
Copy link
Member

@lpinca lpinca commented Feb 25, 2020

Oh, I forgot to use the --flaky-tests flag.

@nodejs-github-bot
Copy link
Contributor

@nodejs-github-bot nodejs-github-bot commented Feb 25, 2020

@sam-github
Copy link
Contributor Author

@sam-github sam-github commented Feb 25, 2020

@AshCripps would it be helpful to get this fast-tracked? I kicked of a full CI on it, but it still needs 25 hours, but we can fast-track given its triviality and impact on CI stability if its blocking bringing the OS X 10.15/Catalina machines into CI.

@AshCripps
Copy link
Member

@AshCripps AshCripps commented Feb 25, 2020

@sam-github Fast track would be useful, pretty sure every release line will fail these tests when 10.15 is added to CI

@nodejs-github-bot
Copy link
Contributor

@nodejs-github-bot nodejs-github-bot commented Feb 25, 2020

@sam-github
Copy link
Contributor Author

@sam-github sam-github commented Feb 25, 2020

@nodejs/build @nodejs/testing Can we fast-track marking these tests flaky?

@sam-github sam-github added the fast-track label Feb 25, 2020
@sam-github
Copy link
Contributor Author

@sam-github sam-github commented Feb 25, 2020

Btw, the build status reported is incorrect - PR passed on everything but arm, as would be expected. I kicked a resume on the PR, though.

@nodejs-github-bot
Copy link
Contributor

@nodejs-github-bot nodejs-github-bot commented Feb 26, 2020

@sam-github
Copy link
Contributor Author

@sam-github sam-github commented Feb 26, 2020

Landed in 24a4f76

@sam-github sam-github closed this Feb 26, 2020
sam-github added a commit that referenced this issue Feb 26, 2020
They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X.

Refs: #30030
Refs: nodejs/build#2189 (comment)

PR-URL: #31936
Reviewed-By: Luigi Pinca <luigipinca@gmail.com>
Reviewed-By: Beth Griggs <Bethany.Griggs@uk.ibm.com>
Reviewed-By: James M Snell <jasnell@gmail.com>
Reviewed-By: Rod Vagg <rod@vagg.org>
BethGriggs pushed a commit that referenced this issue Feb 27, 2020
They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X.

Refs: #30030
Refs: nodejs/build#2189 (comment)

PR-URL: #31936
Reviewed-By: Luigi Pinca <luigipinca@gmail.com>
Reviewed-By: Beth Griggs <Bethany.Griggs@uk.ibm.com>
Reviewed-By: James M Snell <jasnell@gmail.com>
Reviewed-By: Rod Vagg <rod@vagg.org>
codebytere pushed a commit that referenced this issue Feb 27, 2020
They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X.

Refs: #30030
Refs: nodejs/build#2189 (comment)

PR-URL: #31936
Reviewed-By: Luigi Pinca <luigipinca@gmail.com>
Reviewed-By: Beth Griggs <Bethany.Griggs@uk.ibm.com>
Reviewed-By: James M Snell <jasnell@gmail.com>
Reviewed-By: Rod Vagg <rod@vagg.org>
@codebytere codebytere mentioned this pull request Feb 29, 2020
@sam-github sam-github deleted the catalina-udp-flakes branch Mar 6, 2020
puzpuzpuz pushed a commit to puzpuzpuz/node that referenced this issue Mar 8, 2020
They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X.

Refs: nodejs#30030
Refs: nodejs/build#2189 (comment)

PR-URL: nodejs#31936
Reviewed-By: Luigi Pinca <luigipinca@gmail.com>
Reviewed-By: Beth Griggs <Bethany.Griggs@uk.ibm.com>
Reviewed-By: James M Snell <jasnell@gmail.com>
Reviewed-By: Rod Vagg <rod@vagg.org>
@targos targos added backported-to-v12.x and removed lts-watch-v12.x labels Mar 8, 2020
@BethGriggs BethGriggs mentioned this pull request Mar 12, 2020
codebytere pushed a commit that referenced this issue Mar 14, 2020
They fail on OS X 10.15 (aka "Catalina"), but pass on earlier OS X.

Refs: #30030
Refs: nodejs/build#2189 (comment)

PR-URL: #31936
Reviewed-By: Luigi Pinca <luigipinca@gmail.com>
Reviewed-By: Beth Griggs <Bethany.Griggs@uk.ibm.com>
Reviewed-By: James M Snell <jasnell@gmail.com>
Reviewed-By: Rod Vagg <rod@vagg.org>

PR-URL: #32146
Reviewed-By: Rich Trott <rtrott@gmail.com>
Reviewed-By: Vladimir de Turckheim <vlad2t@hotmail.com>
Reviewed-By: Stephen Belanger <admin@stephenbelanger.com>
Reviewed-By: Ruben Bridgewater <ruben@bridgewater.de>
Reviewed-By: Shelley Vohr <codebytere@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backported-to-v12.x fast-track flaky-test test
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants