Skip to content

switch to with-connect for integration tests#355

Open
karawoo wants to merge 11 commits into
mainfrom
kara-with-connect
Open

switch to with-connect for integration tests#355
karawoo wants to merge 11 commits into
mainfrom
kara-with-connect

Conversation

@karawoo

@karawoo karawoo commented May 29, 2026

Copy link
Copy Markdown
Contributor

moves integration tests to use with-connect and adds a weekly scheduled run so that we catch failures on upcoming connect releases even if we're not actively pushing code to this repo

closes #353

the Connect containers used by with-connect have specific R and Python versions that are different from the previous integration testing setup, so getting tests to pass required a fair amount of dependency work (and sorry for the size of this diff):

  • updated Python packages to versions with pre-built wheels for the Python versions in the containers. This raises the minimum Python version for some extensions to >= 3.11, since pandas 3.0.3 (the lowest version with Python 3.14 wheels) requires it.
  • updated R packages to newer versions compatible with R 4.6.0 (which had significant changes to R's C API)
  • small code adjustments to work with the newer package versions

@amylin1249 there will probably be some merge conflicts between this and some of your other in-progress PRs so we'll have to sort that out when they start merging.

@karawoo karawoo force-pushed the kara-with-connect branch from 41afd3c to 881a443 Compare May 29, 2026 22:30
@github-actions

github-actions Bot commented May 29, 2026

Copy link
Copy Markdown
Contributor

Extension release summary

🚀 Will release on merge

  • connectwidgets-example: 0.0.10.0.2
  • portfolio-dashboard: 0.0.20.0.3
  • portfolio-report: 0.0.10.0.2
  • pqr: 0.1.00.1.1
  • quarto-stock-report-r: 1.0.11.0.2
  • runtime-version-scanner: 1.0.21.0.3
  • script-python: 1.0.01.0.1
  • script-r: 1.0.01.0.1
  • simple-mcp-server: 0.0.40.0.5
  • stock-api-fastapi: 1.0.01.0.1
  • stock-api-flask: 1.0.01.0.1
  • stock-api-plumber: 1.0.01.0.1
  • stock-dashboard-python: 1.0.01.0.1
  • stock-report-jupyter: 1.0.01.0.1
  • stock-report: 1.0.01.0.1
  • top-5-income-share-bokeh: 1.0.01.0.1
  • top-5-income-share-shiny: 1.0.01.0.1
  • top-5-income-share-streamlit: 1.0.01.0.1
  • voila-example: 1.0.01.0.1

😴 Changed but won't release

The following extensions have code changes but the manifest version hasn't been incremented:

  • chat-with-content: manifest version 0.0.6 ≤ released version 0.0.6
  • content-health-monitor: manifest version 1.0.1 ≤ released version 1.0.1
  • landing-page: manifest version 1.0.0 ≤ released version 1.0.0
  • package-vulnerability-scanner: manifest version 3.0.4 ≤ released version 3.0.4
  • publisher-command-center: manifest version 0.0.7 ≤ released version 0.0.7
  • quarto-document: manifest version 1.0.1 ≤ released version 1.0.1
  • quarto-presentation: manifest version 1.0.0 ≤ released version 1.0.0
  • quarto-stock-report-python: manifest version 1.0.2 ≤ released version 1.0.2
  • quarto-website: manifest version 1.0.0 ≤ released version 1.0.0
  • simple-shiny-chat-with-mcp: manifest version 0.0.5 ≤ released version 0.0.5
  • usage-metrics-dashboard: manifest version 1.0.14 ≤ released version 1.0.14

If you intended to release these changes, update the version field in each extension's manifest.json.

See the contributing guide for details.

@karawoo karawoo force-pushed the kara-with-connect branch 2 times, most recently from 07e1d51 to 689de97 Compare June 2, 2026 21:06
@karawoo karawoo force-pushed the kara-with-connect branch from 689de97 to 4829a77 Compare June 8, 2026 19:13
@karawoo karawoo force-pushed the kara-with-connect branch 2 times, most recently from efe897d to 4dac19b Compare June 8, 2026 23:15
@karawoo karawoo force-pushed the kara-with-connect branch 3 times, most recently from 08bc82c to bf77738 Compare June 9, 2026 04:22
@karawoo karawoo force-pushed the kara-with-connect branch 2 times, most recently from ffed0a9 to 4fc938d Compare June 9, 2026 04:55
@karawoo karawoo force-pushed the kara-with-connect branch from 4fc938d to c1dcd1b Compare June 9, 2026 05:09
@karawoo karawoo marked this pull request as ready for review June 9, 2026 05:26
@karawoo karawoo requested review from amylin1249 and dotNomad June 9, 2026 05:26

@dotNomad dotNomad left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Having reviewed the non-extensions bit so far I think the only thing I'm seeing is that we should up the GitHub action versions and see if CI still passes without issue just to be sure we aren't missing some param name change or something.

chat-with-content: extensions/chat-with-content/**
pqr: extensions/pqr/**

# When infra changed, test all simple extensions; otherwise use the filter output

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Smart inclusion here for testing this.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it does have the side effect of reporting that extensions have been "changed" (they haven't) but won't be released.

image

I don't think it's a big deal, but we could try to refactor if it gets confusing.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think that's a huge deal. Like you said we can adjust in the future if need be.

Comment on lines +3 to +5
# Runs integration tests for ALL extensions against all compatible Connect
# versions. Catches regressions from upcoming Connect releases even when
# extension code hasn't changed.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very nice inclusion 🎉

Comment thread .github/workflows/weekly-integration-tests.yml Outdated
Comment thread .github/workflows/weekly-integration-tests.yml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Update integration testing to use with-connect

2 participants