Oasis June 2025 Engineering update

e.g. https://wallet.oasis.io/account/oasis1qqazrhk6l3v23nzk098p0dq9xlv5rfkpn50mjxdd

Screenshots CI was still broken. https://github.com/oasisprotocol/wallet/actions/workflows/update-screenshots.yml

All causes since #2174:

• images were broken (#2182)
• defaultProps in our app showed warning overlays covering buttons clicked in screenshot script (#2181)
• defaultProps in previous grommet (#2181)
• mocking requests and debug prints showed warning overlays (#2184)
• "Select a ParaTime" isn't a textbox in new grommet (this PR)

Fixes #479, #480

This PR:

• shows the oasis rofl update warning when removing secret too
• shows the oasis rofl update warning when running rofl upgrade, if there are any changes to the manifest
• docs: moves rofl rm to advanced section
• docs: improve rofl deploy docs and mentions ROFL marketplace
• docs: rofl upgrade command
• docs: rofl secret command
• docs: rofl provider command

Required by oasisprotocol/docs#1261

Requires at least rofl-scheduler 0.2.0 on the provider side (currently in oasisprotocol/oasis-sdk#2236) with Oasis Core master.

Closes #462.

Closes #487 and #508.

Fixes #498

Closes #416.

Waiting for client-sdk/go/v0.14.1.

Closes #415.

Use Oasis-managed Mainnet ROFL provider by default.

Fixes #503

You typically don't encrypt test accounts when developing ROFLs, so the -y flag comes handy in this case to check the logs.

In the old code, when the block analyzer was near the head of the chain, the backoff was almost always at 6 seconds.

See retry interval quickly increasing to 6 seconds on a recently started node that is at the head of the chain:

{"analyzer":"sapphire","caller":"block.go:420","height":12287791,"level":"info","mode":"slow-sync","module":"analysis_service","msg":"no data available; will retry","retry_interval_ms":100,"ts":"2025-06-25T08:36:03.901279912Z"}
{"analyzer":"sapphire","caller":"block.go:420","height":12287791,"level":"info","mode":"slow-sync","module":"analysis_service","msg":"no data available; will retry","retry_interval_ms":200,"ts":"2025-06-25T08:36:04.13376454Z"}
{"analyzer":"sapphire","caller":"block.go:420","height":12287791,"level":"info","mode":"slow-sync","module":"analysis_service","msg":"no data available; will retry","retry_interval_ms":400,"ts":"2025-06-25T08:36:04.570368877Z"}
{"analyzer":"sapphire","caller":"block.go:420","height":12287791,"level":"info","mode":"slow-sync","module":"analysis_service","msg":"no data available; will retry","retry_interval_ms":800,"ts":"2025-06-25T08:36:05.403994745Z"}
{"analyzer":"sapphire","caller":"block.go:420","height":12287792,"level":"info","mode":"slow-sync","module":"analysis_service","msg":"no data available; will retry","retry_interval_ms":1440,"ts":"2025-06-25T08:36:07.952763714Z"}
{"analyzer":"sapphire","caller":"block.go:420","height":12287792,"level":"info","mode":"slow-sync","module":"analysis_service","msg":"no data available; will retry","retry_interval_ms":2880,"ts":"2025-06-25T08:36:10.862558227Z"}
{"analyzer":"sapphire","caller":"block.go:420","height":12287794,"level":"info","mode":"slow-sync","module":"analysis_service","msg":"no data available; will retry","retry_interval_ms":4665,"ts":"2025-06-25T08:36:21.879480568Z"}
{"analyzer":"sapphire","caller":"block.go:420","height":12287798,"level":"info","mode":"slow-sync","module":"analysis_service","msg":"no data available; will retry","retry_interval_ms":6000,"ts":"2025-06-25T08:36:46.568709867Z"}
{"analyzer":"sapphire","caller":"block.go:420","height":12287803,"level":"info","mode":"slow-sync","module":"analysis_service","msg":"no data available; will retry","retry_interval_ms":6000,"ts":"2025-06-25T08:37:21.578675488Z"}
{"analyzer":"sapphire","caller":"block.go:420","height":12287810,"level":"info","mode":"slow-sync","module":"analysis_service","msg":"no data available; will retry","retry_interval_ms":5739,"ts":"2025-06-25T08:38:03.155313823Z"}
{"analyzer":"sapphire","caller":"block.go:420","height":12287817,"level":"info","mode":"slow-sync","module":"analysis_service","msg":"no data available; will retry","retry_interval_ms":5490,"ts":"2025-06-25T08:38:43.316051961Z"}

This often caused the analyzers to lag behind the head by 1–2 blocks. There were a couple of reasons for this, so we’ve restructured the code, simplified the logic, and adjusted the backoff behavior for block analyzers.

Summary of changes:

• Added detection for when we are at the head of the chain (isRecentOutOfRangeError). In such cases, we now poll every 1 second.
• Increased the maximum backoff to 30 seconds (can be raised in the future) for errors not related to being at the head of the chain.

In practice, a failing analyzer should now send queries less frequently (previously every 6 seconds, now up to a 30-second maximum timeout). However, after recovering, or when at the head of the chain, it should resume polling more quickly (every 1 second).

Fixes #910

• add indexes for efficient evmabi-backfill analyzer queries, and update the queries for efficient index usage
• make abi_parsed_at field in runtime_transactions and events non-nill, to simplify queries and improve index usage

TODO:

• test migration on mainnet db: ~40 hours
• test new queries performance on mainnet or testnet db
  • almost instant, and using the indexes as expected

RuntimeEvmVerifiedContractTxs
                                                                                                QUERY PLAN
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Limit  (cost=698040.63..698043.13 rows=1000 width=880) (actual time=134.601..134.607 rows=7 loops=1)
  ->  Sort  (cost=698040.63..698465.63 rows=170000 width=880) (actual time=134.600..134.604 rows=7 loops=1)
        Sort Key: tx.round DESC
        Sort Method: quicksort  Memory: 73kB
        ->  Nested Loop  (cost=0.69..688719.71 rows=170000 width=880) (actual time=95.900..134.496 rows=7 loops=1)
              ->  Seq Scan on evm_contracts  (cost=0.00..854.34 rows=170 width=765) (actual time=0.119..2.820 rows=373 loops=1)
                    Filter: ((abi IS NOT NULL) AND (runtime = 'sapphire'::runtime))
                    Rows Removed by Filter: 10437
              ->  Limit  (cost=0.69..4021.27 rows=1000 width=724) (actual time=0.271..0.352 rows=0 loops=373)
                    ->  Index Scan using ix_runtime_transactions_to_round_abi_parsed_at on runtime_transactions tx  (cost=0.69..85976.66 rows=21384 width=724) (actual time=0.271..0.352 rows=0 loops=373)
                          Index Cond: ((runtime = evm_contracts.runtime) AND (("to")::text = (evm_contracts.contract_address)::text) AND (abi_parsed_at < evm_contracts.verification_info_downloaded_at))
Planning Time: 0.424 ms
Execution Time: 134.690 ms
(13 rows)

RuntimeEvmVerifiedContractEvents
                                                                                                      QUERY PLAN
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Limit  (cost=361266.87..361269.37 rows=1000 width=982) (actual time=96.899..97.013 rows=1000 loops=1)
  ->  Sort  (cost=361266.87..361691.87 rows=170000 width=982) (actual time=96.897..96.946 rows=1000 loops=1)
        Sort Key: e.round DESC
        Sort Method: top-N heapsort  Memory: 2049kB
        ->  Nested Loop  (cost=1.25..351945.95 rows=170000 width=982) (actual time=29.907..78.912 rows=27234 loops=1)
              ->  Nested Loop  (cost=0.56..2311.66 rows=170 width=786) (actual time=0.105..8.796 rows=360 loops=1)
                    ->  Seq Scan on evm_contracts  (cost=0.00..854.34 rows=170 width=765) (actual time=0.074..2.877 rows=373 loops=1)
                          Filter: ((abi IS NOT NULL) AND (runtime = 'sapphire'::runtime))
                          Rows Removed by Filter: 10437
                    ->  Index Scan using address_preimages_pkey on address_preimages p  (cost=0.56..8.57 rows=1 width=68) (actual time=0.015..0.015 rows=1 loops=373)
                          Index Cond: ((address)::text = (evm_contracts.contract_address)::text)
              ->  Limit  (cost=0.70..2046.67 rows=1000 width=229) (actual time=0.108..0.187 rows=76 loops=360)
                    ->  Index Scan using ix_runtime_events_abi_parsed_at on runtime_events e  (cost=0.70..250573.28 rows=122471 width=229) (actual time=0.107..0.182 rows=76 loops=360)
                          Index Cond: ((runtime = evm_contracts.runtime) AND ((body ->> 'address'::text) = encode(p.address_data, 'base64'::text)) AND (abi_parsed_at < evm_contracts.verification_info_downloaded_at))
Planning Time: 1.598 ms
Execution Time: 97.192 ms
(16 rows)

Fixes: #1051

Fixes #1062 (likely)

Not sure how I missed this in the initial impl.

Fixes #1039

Initially, rofl apps did not have metadata. Update rofl instances to support metadata and queue refresh of all active rofl apps, so that the instance metadata is fetched.

Fixes #1048

This makes the query ValidatorStakingHistoryUnprocessedEpochs used by validator_history analyzer efficient.

The table and the index are small compared to other tables, so overhead by adding this index is small.

This makes it consistent with other (runtime) block analyzers.

Fixes: #1041

"Active instances" are computed by just looking at the expiration epoch. However removed apps don't have any active instances (even if the expiration has not yet expired). So just don't compute active instances for that case. That will also fix the sorting, since currently it can happen that a removed app will show up before non-removed one, due to the misleading "active instances".

Includes: oasisprotocol/oasis-sdk#2230

After the fix is confirmed, tag a new oasis-sdk version and update to that.

Before this change, we executed all text searches looking for an exact match. So if we searched for "apple pie", it matched "apple pie", but not "apple-pie", and definitely not "pie with apple".

However, Nexus has now (oasisprotocol/nexus#1026) enhanced the search feature for rofl apps and evm tokens to cover these cases, too.

So this PR introduces flexible multi-word searching for all text searches. The search query is tokenized, and we are searching for all of them independently. We have a match if all of them are found, in whatever order.

Here are a few test searched with work with this PR, but didn't work earlier:

• Account name: https://pr-2012.oasis-explorer.pages.dev/search?q=address+burn
• Network change proposal: https://pr-2012.oasis-explorer.pages.dev/search?q=staking+change
• ROFL app: https://pr-2012.oasis-explorer.pages.dev/search?q=rope+dam
• Validator: https://pr-2012.oasis-explorer.pages.dev/search?q=one+chorus
• Token: https://pr-2012.oasis-explorer.pages.dev/testnet/sapphire/search?q=gold+duck
• Voter name (for proposal): https://pr-2012.oasis-explorer.pages.dev/mainnet/consensus/proposal/4?voter=sta+ma

For reviewers: I suggest going commit by commit.

This is a follow-up to #2002, where @lukaw3d commented:

I somewhat prefer string literals 🤷

So, this PR increases the usage of string literals, instead of Layer and Network constants.

So,

• Network.mainnet => 'mainnet'
• Layer.sapphire => 'sapphire'

etc.

Fixes #2036
https://explorer.oasis.io/testnet/sapphire/address/oasis1qp2ens0hsp7gh23wajxa4hpetkdek3swyyulyrmz

• Replace string literals with proper constants
• Introduce ConsensusScope and RuntimeScope
  for situations when we expect a specific type of scope.
• Introduce useRuntimeScope() and useConsensusScope()
  hooks which verify that we have the right kind of scope.
  (This makes checking in the individual components unnecessary.)
• Remove hard-wiring "sapphire" for all rofl-related pages
  (We already have feature flags for runtimes to enable/disable rofl)

• orval throws import.meta warning, but it works. not sure how to make it happy
• requires additional QA on staging

This PR is an updated version of #1987, rebased on top of #2012, so that it has the latest multi-word flex search.

See demo of flex search in the Rofl app list here: https://pr-2013.oasis-explorer.pages.dev/testnet/sapphire/rofl/app?name=tg+cha

Original description follows.

===========

The Nexus API has already added support for filtering the Rofl app list by name in oasisprotocol/nexus#997.

In Explorer, currently this is only unitized in the global search since #1973/. (So that we can find Rofl apps from the global search field.)

This PR adds name/based filtering to the Rofl app list page itself.

I suggest reviewing commit by commit, because the different commits add different (small) features, and also there were some preparatory code refactorings, which would otherwise obscure the actual changes.

Screenshots

Filtering the list on the desktop

When no match:

On mobile:

On mobile, vertical mode:

No match on mobile:

Improves #1999

Now a failing query won't collapse the whole consensus dashboard, only the relevant card.
Every card has been split to two component, and the internal parts are now wrapped in the appropriate error boundaries.
The same could be done to the paratime dashboard, too.
Plus, the design could obviously improved, but this already avoids the collapsing of the whole board, so definitely improves the UX.

Before, if any of the queries have a problem:

Instead of this, now we get:

Failing to load blocks:

Failing to load validators:

Failing to load paratimes:

Failing to load accounts:

Failing to load transactions:

Network change proposals: