openwhisk.git
46 hours agoFix minor ansible typos (#5329) master
Erika Hunhoff [Thu, 29 Sep 2022 04:18:13 +0000 (22:18 -0600)] 
Fix minor ansible typos (#5329)

* Fix typo in ansible documentation

* Typo in scheduler deploy.yml

2 days agochange default warmed container keeping count (#5328)
Brendan Doyle [Wed, 28 Sep 2022 18:18:55 +0000 (14:18 -0400)] 
change default warmed container keeping count (#5328)

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
2 days agoAdd Function Cache Refresh If Invoker Is Running Container For Function (#5327)
Brendan Doyle [Wed, 28 Sep 2022 18:16:06 +0000 (14:16 -0400)] 
Add Function Cache Refresh If Invoker Is Running Container For Function (#5327)

* wip

* wip

* add cache refresh to container proxy

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
7 days agoFix Orphaned Container Edge Case In Paused State of Container Proxy (#5326)
Brendan Doyle [Fri, 23 Sep 2022 13:57:13 +0000 (09:57 -0400)] 
Fix Orphaned Container Edge Case In Paused State of Container Proxy (#5326)

* fix orphaned container edge case in proxy paused state

* enhance test

* feedback

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
2 weeks agoadd container and creation ids to logs when queue attempts to stop for better debuggi...
Brendan Doyle [Tue, 13 Sep 2022 02:40:10 +0000 (19:40 -0700)] 
add container and creation ids to logs when queue attempts to stop for better debugging (#5324)

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
3 weeks agoAdd note on concurrency limit config (#5103)
davidfrickert [Fri, 9 Sep 2022 22:39:57 +0000 (23:39 +0100)] 
Add note on concurrency limit config (#5103)

3 weeks agoPrepare to integrate new scheduler into apache/openwhisk-deploy-kube (#5278)
Erika Hunhoff [Mon, 5 Sep 2022 01:31:58 +0000 (19:31 -0600)] 
Prepare to integrate new scheduler into apache/openwhisk-deploy-kube (#5278)

* Kubernetes Akka bootstrap for controller

* Update cluster management for the scheduler to help with k8s deployment

* Made changes to tools to try to integrate scheduler into travis/CI build
process

* Added scheduler Dockerfile.cov

* Use consistent ordering of components

* remove canonical.port setting in scheduler, controller

* Remove unneeded dependency from controller, scheduler

* Remove cluster creation from ShardingContainerPoolBalancer

* Remove trailing whitespace

Signed-off-by: Erika Hunhoff <hunhoff.erika@gmail.com>
* Revert akka cluster changes to controller

Signed-off-by: Erika Hunhoff <hunhoff.erika@gmail.com>
Signed-off-by: Erika Hunhoff <hunhoff.erika@gmail.com>
4 weeks agoadd config to fail async scheduler throttles as whisk errors (#5305)
Brendan Doyle [Thu, 1 Sep 2022 21:08:16 +0000 (14:08 -0700)] 
add config to fail async scheduler throttles as whisk errors (#5305)

* add config to fail async scheduler throttles as whisk errors

* fix tests

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
4 weeks agoadd error handling to container manager when invoker query fails (#5320)
Brendan Doyle [Wed, 31 Aug 2022 23:43:15 +0000 (16:43 -0700)] 
add error handling to container manager when invoker query fails (#5320)

* add error handling to container manager when invoker query fails

* fix tests

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
4 weeks agoRevert etcd client version (#5318)
Dominic Kim [Mon, 29 Aug 2022 01:31:13 +0000 (10:31 +0900)] 
Revert etcd client version (#5318)

5 weeks agoSkip scheduling for empty cold creation. (#5316)
Dominic Kim [Wed, 24 Aug 2022 09:20:53 +0000 (18:20 +0900)] 
Skip scheduling for empty cold creation. (#5316)

5 weeks agouse openwhisk-client-js 3.21.7 (#5315)
David Grove [Tue, 23 Aug 2022 01:04:01 +0000 (21:04 -0400)] 
use openwhisk-client-js 3.21.7 (#5315)

5 weeks agoadd config to mask docker run args when logging (#5310)
Brendan Doyle [Mon, 22 Aug 2022 21:01:41 +0000 (14:01 -0700)] 
add config to mask docker run args when logging (#5310)

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
5 weeks agobump java etcd client to 0.0.21 (#5309)
Brendan Doyle [Mon, 22 Aug 2022 21:00:16 +0000 (14:00 -0700)] 
bump java etcd client to 0.0.21 (#5309)

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
5 weeks agoExclude warmed containers in disabled invokers. (#5313)
Dominic Kim [Mon, 22 Aug 2022 05:08:03 +0000 (14:08 +0900)] 
Exclude warmed containers in disabled invokers. (#5313)

* Exclude warmed containers in disabled invokers.

* Exclude warmed containers in disabled invokers.

* Find the first warmed container.

* Remove the code added by mistake.

* Add more logs for error cases.

6 weeks agoAdd document for support array result (#5311)
ningyougang [Thu, 18 Aug 2022 08:09:21 +0000 (16:09 +0800)] 
Add document for support array result (#5311)

* Fix test case failed for swift

* Add document based on support array result feature

* Apply review comments

7 weeks agoAdd fake clock for test code (#5304)
Seonghyun Oh [Tue, 9 Aug 2022 02:04:44 +0000 (11:04 +0900)] 
Add fake clock for test code (#5304)

* Add fake clock for test code

* Add test code for state timeout

* Add test case for transaction _ => Flushing

* Add StateTimeout test for Flushing state

8 weeks agoSupport backward compatibility for runtime's return type (#5306)
Seonghyun Oh [Thu, 4 Aug 2022 01:32:11 +0000 (10:32 +0900)] 
Support backward compatibility for runtime's return type (#5306)

8 weeks agoGo to the NamespaceThrottled state rather than Flushing state. (#5303)
Dominic Kim [Wed, 3 Aug 2022 08:39:32 +0000 (17:39 +0900)] 
Go to the NamespaceThrottled state rather than Flushing state. (#5303)

* Currently MemoryQueue will go to Flushing state when receive a EnableNamespaceThrottling(dropMsg=true) message, but the Flushing state doesn't have a case to disable namespace throttling at all.

* Remove unused import.

8 weeks agoAdjust the default configurations. (#5302)
Dominic Kim [Wed, 3 Aug 2022 08:39:23 +0000 (17:39 +0900)] 
Adjust the default configurations. (#5302)

* Adjust the default configurations.

* Change the default etcd retention to string.

8 weeks agoRevert cycle handling. (#5300)
Dominic Kim [Tue, 2 Aug 2022 01:54:58 +0000 (10:54 +0900)] 
Revert cycle handling. (#5300)

* Revert cycle handling.

* Remove the RecoverQueue reference.

8 weeks agoSupport array result for common action and sequence action (#5290)
ningyougang [Mon, 1 Aug 2022 09:32:12 +0000 (17:32 +0800)] 
Support array result for common action and sequence action (#5290)

* Support array result

* Make controller accept json array

* Make elasticsearch support json array

Couchdb already suports

* Make go runtime test cases due to depend on this

* Add test case for array result for nodejs runtime

* Make sequence action to support array result

* Optimize sequence action to support array result

* Fix test case for sequence action feature

* Add test case for sequence action

This test case is just for nodejs

* Add extra method runForJsArray for runtime tests

* Fix build error

* Fix review comment

2 months agochore: remove duplicate entry from .gitignore (#5090)
John Bampton [Sat, 30 Jul 2022 04:06:03 +0000 (14:06 +1000)] 
chore: remove duplicate entry from .gitignore (#5090)

2 months agopoem for max action container concurrency (#5288)
Brendan Doyle [Fri, 29 Jul 2022 16:51:10 +0000 (09:51 -0700)] 
poem for max action container concurrency (#5288)

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
2 months agoAdd missing configurations. (#5297)
Dominic Kim [Fri, 29 Jul 2022 04:43:09 +0000 (13:43 +0900)] 
Add missing configurations. (#5297)

2 months agoThis is to make sure activations for a shared action run in an invocation namespace...
Dominic Kim [Fri, 29 Jul 2022 04:42:59 +0000 (13:42 +0900)] 
This is to make sure activations for a shared action run in an invocation namespace. (#5296)

2 months agoBumping to gradle 6 (#5276)
Seonghyun Oh [Thu, 28 Jul 2022 16:01:59 +0000 (01:01 +0900)] 
Bumping to gradle 6 (#5276)

* Use implementation instead of compile

* Fix com.lihaoyi:fastparse dependency version conflicts

* Bump to gradle 6.9.1

* Bump to scoverage 7.0.0

* Add dependsOn 'compileScoverageScala'

2 months ago[Proposal] POEM: provide array result for all runtime images (#5244)
ningyougang [Thu, 28 Jul 2022 09:03:39 +0000 (17:03 +0800)] 
[Proposal] POEM: provide array result for all runtime images (#5244)

* POEM support array result

* Add missing runtime

* Apply review comment

2 months agoDo not put data to ETCD when no date is changed. (#5291)
Dominic Kim [Wed, 27 Jul 2022 01:21:58 +0000 (10:21 +0900)] 
Do not put data to ETCD when no date is changed. (#5291)

* Do not put data to ETCD when no date is changed.

* Update the hashcode calculation.

* Take dedicated namespace into account when calculating the hash code.

* Apply the comment.

* Apply the comment.

2 months agoAdjust error for container creation. (#5295)
Dominic Kim [Wed, 27 Jul 2022 01:21:49 +0000 (10:21 +0900)] 
Adjust error for container creation. (#5295)

When an action is already updated but activations with an old revision arrive, this error can happen.
It is not supposed to happen in a normal case but it might happen when a cache invalidation issue happens for some reason.

2 months agoChange the value of pause-grace for new scheduler (#5221)
Jesse Stutler [Tue, 26 Jul 2022 05:12:18 +0000 (13:12 +0800)] 
Change the value of pause-grace for new scheduler (#5221)

2 months agoMake ElasticSearch ports configurable. (#5294)
Dominic Kim [Tue, 26 Jul 2022 04:38:10 +0000 (13:38 +0900)] 
Make ElasticSearch ports configurable. (#5294)

2 months agoUpdate wrong error message "action does not exist". (#5293)
Dominic Kim [Mon, 25 Jul 2022 12:36:35 +0000 (21:36 +0900)] 
Update wrong error message "action does not exist". (#5293)

2 months agoDedicated Invokers (#5292)
Dominic Kim [Sun, 24 Jul 2022 10:44:40 +0000 (19:44 +0900)] 
Dedicated Invokers (#5292)

* Support dedicated invokers.

This is to provide dedicated invokers for a namespace. Operators can configure a dedicated namespace for invokers and all activations from the namespace will be delivered to the dedicated invokers only.

* Add documentation.

2 months agoAdd tags to invokers. (#5289)
Dominic Kim [Fri, 22 Jul 2022 02:25:26 +0000 (11:25 +0900)] 
Add tags to invokers. (#5289)

* Add tags to invokers.

* Add a log to figure out invoker tags.

* Update the invoker tag log.

* Add documentation about the tag-based scheduling.

2 months agoSupport graceful shutdown. (#5283)
Dominic Kim [Tue, 19 Jul 2022 06:01:36 +0000 (15:01 +0900)] 
Support graceful shutdown. (#5283)

2 months agoAdd a documentation for warmed containers configurations. (#5282)
Dominic Kim [Fri, 15 Jul 2022 05:31:47 +0000 (14:31 +0900)] 
Add a documentation for warmed containers configurations. (#5282)

2 months agoRetry on any errors. (#5280)
Dominic Kim [Fri, 15 Jul 2022 05:29:34 +0000 (14:29 +0900)] 
Retry on any errors. (#5280)

* Retry on any errors.

* Change the variable name.

2 months agoIncrease the payload limit. (#5279)
Dominic Kim [Fri, 15 Jul 2022 05:29:21 +0000 (14:29 +0900)] 
Increase the payload limit. (#5279)

2 months agoAdd retry to store activations. (#5277)
Dominic Kim [Fri, 15 Jul 2022 05:29:09 +0000 (14:29 +0900)] 
Add retry to store activations. (#5277)

2 months agoUpgrade the Kubernetes client version. (#5275)
Dominic Kim [Fri, 15 Jul 2022 05:28:22 +0000 (14:28 +0900)] 
Upgrade the Kubernetes client version. (#5275)

2 months agoForward header from a trigger to actions. (#5273)
Dominic Kim [Fri, 15 Jul 2022 05:28:03 +0000 (14:28 +0900)] 
Forward header from a trigger to actions. (#5273)

* Forward header from a trigger to actions.

* Add the Apache header.

2 months agoFail all activations when it fails to pull a blackbox image. (#5270)
Dominic Kim [Fri, 15 Jul 2022 05:27:34 +0000 (14:27 +0900)] 
Fail all activations when it fails to pull a blackbox image. (#5270)

* Fail all activations if it fails to pull images for blackbox actions.

* Apply scalaFmt.

* Remove 127 from the case.

2 months agoFix scheduler inProgressDuration parsing (#5281)
Erika Hunhoff [Thu, 14 Jul 2022 10:44:57 +0000 (04:44 -0600)] 
Fix scheduler inProgressDuration parsing (#5281)

2 months ago[Scheduler Enhancement] Increase the retention timeout for the blackbox action. ...
Dominic Kim [Tue, 12 Jul 2022 10:56:13 +0000 (19:56 +0900)] 
[Scheduler Enhancement] Increase the retention timeout for the blackbox action. (#5266)

* Increase the retention timeout for the blackbox action.

* Fix test cases.

* Apply scalaFmt.

* Add GracefulShutdown case back.

* Increase the blackbox timeout for test cases.

* Access the private method directly.

* Replace Thread.sleep with awaitAssert

* Add the missing configuration.

* Enhance the test code.

* Remove thread.sleep.

* Fix test cases.

* Fix test cases.

2 months agoMake proxy timeouts configurable. (#5272)
Dominic Kim [Tue, 12 Jul 2022 06:35:11 +0000 (15:35 +0900)] 
Make proxy timeouts configurable. (#5272)

2 months agoAdd test cases to make sure an invoker properly boots up in terms of ETCD keys. ...
Dominic Kim [Tue, 12 Jul 2022 06:34:58 +0000 (15:34 +0900)] 
Add test cases to make sure an invoker properly boots up in terms of ETCD keys. (#5271)

2 months agoConsider binding action when creating or recovering queue. (#5267)
Dominic Kim [Tue, 12 Jul 2022 06:34:34 +0000 (15:34 +0900)] 
Consider binding action when creating or recovering queue. (#5267)

2 months agoadd support for etcd client authentication (#5269)
Brendan Doyle [Fri, 8 Jul 2022 18:50:47 +0000 (11:50 -0700)] 
add support for etcd client authentication (#5269)

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
2 months ago[Scheduler Enhancement] Remove deleted containers. (#5265)
Dominic Kim [Tue, 5 Jul 2022 02:27:52 +0000 (11:27 +0900)] 
[Scheduler Enhancement] Remove deleted containers. (#5265)

* Apply ScalaFmt.

* Do not send messages to deleted containers.

* Use milliseconds as a measurement unit.

* Fix test code.

3 months agoUpdate npm version for ow-utils docker (#5261)
HGY [Thu, 23 Jun 2022 05:31:45 +0000 (13:31 +0800)] 
Update npm version for ow-utils docker (#5261)

3 months agorework scheduler wait time metric (#5258)
Brendan Doyle [Wed, 15 Jun 2022 11:24:18 +0000 (04:24 -0700)] 
rework scheduler wait time metric (#5258)

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
3 months agoRemove containers gradually when disable invoker (#5253)
jiangpengcheng [Thu, 2 Jun 2022 03:34:47 +0000 (11:34 +0800)] 
Remove containers gradually when disable invoker (#5253)

3 months agofix scheduling config loading wrong config (#5255)
Brendan Doyle [Wed, 1 Jun 2022 16:56:25 +0000 (09:56 -0700)] 
fix scheduling config loading wrong config (#5255)

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
4 months agoPrevent cycle sending (#5251)
jiangpengcheng [Tue, 31 May 2022 23:09:20 +0000 (07:09 +0800)] 
Prevent cycle sending (#5251)

4 months agoIntroduce scheduling configurations. (#5232)
Dominic Kim [Tue, 31 May 2022 23:08:54 +0000 (08:08 +0900)] 
Introduce scheduling configurations. (#5232)

* Introduce scheduling configurations.

* Apply SchedulingConfig to MemoryQueue.

* Apply SchedulingConfig to SchedulingDecisionMaker.

* Apply ScalaFmt

* Remove unused import

* Change configs.

* Fix test cases.

* Apply scalaFmt

* Remove Java8-compat dependency.

4 months agoUse pureconfig for invoker/scheduler's basic http auth (#5252)
jiangpengcheng [Tue, 31 May 2022 06:23:36 +0000 (14:23 +0800)] 
Use pureconfig for invoker/scheduler's basic http auth (#5252)

4 months agorefresh runtime versions for nodejs and golang (#5249)
David Grove [Fri, 27 May 2022 00:34:51 +0000 (20:34 -0400)] 
refresh runtime versions for nodejs and golang (#5249)

4 months agoFix missing keystroke in requirements (#5247)
Evgeniy [Fri, 27 May 2022 00:24:19 +0000 (03:24 +0300)] 
Fix missing keystroke in requirements (#5247)

ERROR: Invalid requirement: 'six=1.16.0'
Hint: = is not a valid operator. Did you mean == ?

4 months agoAdd containerPool container histogram metric (#5222)
ningyougang [Fri, 27 May 2022 00:09:19 +0000 (08:09 +0800)] 
Add containerPool container histogram metric (#5222)

* Add containerPool container histogram metric

* Add pod creation consume time metric

* Add docker container creation consume time metric

* Use transaction to calculate

* Add namespace and action tags for container metric

* Avoid send metric repeatedly

* Fix scala 2.13 compilation error

* Update according to review comment

4 months agoAdd missing configuration for scheduler (data-management-service.retry-interval)...
Seonghyun Oh [Thu, 26 May 2022 09:20:59 +0000 (18:20 +0900)] 
Add missing configuration for scheduler (data-management-service.retry-interval) (#5235)

4 months agofix perMin throttle config for fpc (#5245)
Brendan Doyle [Thu, 26 May 2022 07:34:30 +0000 (00:34 -0700)] 
fix perMin throttle config for fpc (#5245)

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
4 months agoupdate action container metrics subactions to action instead of namespace (#5246)
Brendan Doyle [Thu, 26 May 2022 05:40:05 +0000 (22:40 -0700)] 
update action container metrics subactions to action instead of namespace (#5246)

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
4 months agoAdd some testcases and missing ASF headers for new scheduler (#5243)
jiangpengcheng [Thu, 26 May 2022 05:14:05 +0000 (13:14 +0800)] 
Add some testcases and missing ASF headers for new scheduler  (#5243)

* Add some testcases and missing ASF headers for new scheduler

* Reset stream after each test

* Wait more time

* Update msg start time to ensure it's not stale

* Make MemoryQueueFlowTests stable

* Ignore warmUp msg immediately

* Use retry to replace sleep

* Add missing config

* Fix configuration error

4 months ago[Proposal] POEM: Providing action limits for each namespace (#5236)
Seonghyun Oh [Wed, 25 May 2022 05:01:52 +0000 (14:01 +0900)] 
[Proposal] POEM: Providing action limits for each namespace (#5236)

* Add POEM (Providing action limits for each namespace)

* Apply suggestions from code review

Co-authored-by: rodric rabbah <rodric@gmail.com>
* Update POEM-3-action-limit-for-namespace.md

Co-authored-by: rodric rabbah <rodric@gmail.com>
4 months agoadd per min throttling support to fpc (#5241)
Brendan Doyle [Tue, 24 May 2022 19:26:27 +0000 (12:26 -0700)] 
add per min throttling support to fpc (#5241)

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
4 months agoadd fpc load balancer metrics (#5240)
Brendan Doyle [Tue, 24 May 2022 17:30:09 +0000 (10:30 -0700)] 
add fpc load balancer metrics (#5240)

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
4 months agoTake revision into consideration when choose warm container (#5233)
jiangpch [Tue, 24 May 2022 04:52:55 +0000 (12:52 +0800)] 
Take revision into consideration when choose warm container (#5233)

4 months agoFix wrong returned type when reschedule activation msg (#5242)
jiangpch [Mon, 23 May 2022 06:23:57 +0000 (14:23 +0800)] 
Fix wrong returned type when reschedule activation msg (#5242)

4 months agoUse a template for swagger code generating (#5238)
jiangpch [Thu, 19 May 2022 13:33:33 +0000 (21:33 +0800)] 
Use a template for swagger code generating (#5238)

4 months agoUse testcontainers to test MongoDB stuff (#5234)
jiangpch [Tue, 17 May 2022 03:19:03 +0000 (11:19 +0800)] 
Use testcontainers to test MongoDB stuff (#5234)

* Use testcontainers to test MongoDB stuff

* Use compile in gradle for consistency

* Add google repositories

* checking

* Recreate client when config is changed

4 months agoReplace kafka.RecordMetadata with a common ResultMetadata (#5217)
jiangpch [Tue, 10 May 2022 05:21:12 +0000 (13:21 +0800)] 
Replace kafka.RecordMetadata with a common ResultMetadata (#5217)

* Replace kafka.RecordMetadata with a common ResultMetadata

* remove unused import

4 months agosend old version memoryQueue's stale activation to queueManager when update action...
ningyougang [Mon, 9 May 2022 05:51:40 +0000 (13:51 +0800)] 
send old version memoryQueue's stale activation to queueManager when update action (#5228)

* Complele old activation when update action

When old container doesn't exist

* Send old version activation to queueManager to reschedule

* Fix test case error

* Add exponential delay time retry

* Fix test case

* Make queueManager test case more stable

* Optimize memoryQueue test case

* Make test case more stable

* Change method name more readable

4 months agoUpdate Ansible scheduler instructions (#5224)
Erika Hunhoff [Sat, 7 May 2022 06:55:03 +0000 (00:55 -0600)] 
Update Ansible scheduler instructions (#5224)

* Removed extraneous instruction

Akka dispatcher added directly into code in recent commit so this is no longer necessary

* Add directions for scheduler without elasticsearch

4 months agoFix path error (#5225)
Erika Hunhoff [Sat, 7 May 2022 06:53:51 +0000 (00:53 -0600)] 
Fix path error (#5225)

5 months agoAdjust the keeping duration. (#5208)
Dominic Kim [Wed, 6 Apr 2022 01:58:03 +0000 (10:58 +0900)] 
Adjust the keeping duration. (#5208)

5 months agoFix new scheduler error (#5206)
jiangpch [Tue, 5 Apr 2022 19:06:24 +0000 (03:06 +0800)] 
Fix new scheduler error (#5206)

6 months agoUpdate ansible with new scheduler instructions (#5202)
Erika Hunhoff [Wed, 30 Mar 2022 23:03:58 +0000 (17:03 -0600)] 
Update ansible with new scheduler instructions (#5202)

* Update ansible/scheduler instructions

Add instructions to add configuration for akka dispatcher, add complete file paths in two places

* Change lease service to PinnedDispatcher

6 months agoadd enable/disable invoker support to old scheduler (#5205)
Brendan Doyle [Tue, 29 Mar 2022 07:33:56 +0000 (00:33 -0700)] 
add enable/disable invoker support to old scheduler (#5205)

* add enable/disable invoker support to old scheduler and add is enabled route for invoker

* feedback

* fix enable complete

* fail fast invoker to offline with updated ping message

* test compilation

* add tests

* fix tests

Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
7 months ago[New Scheduler] Run scheduler (#5194)
Dominic Kim [Fri, 11 Feb 2022 01:46:56 +0000 (10:46 +0900)] 
[New Scheduler] Run scheduler (#5194)

* Add Akka-cluster dependency

* Update configurations to run the new scheduler.

* Add gRPC handlers for activations.

* Update Ansible scripts to run the new scheduler.

* Increase the queue creation request timeout.

* Add scheduler the ansible role.

* Fix typo.

* Change the loglevel config to logback's one.

* Change the topic name

* Remove unnecessary configs

* Add a guide how to deploy the new scheduler.

* Make ActorSystem for each test bind to a free port.

7 months agoadd system config options for success / failure levels to write blocking / non-blocki...
Brendan Doyle [Tue, 1 Feb 2022 06:24:00 +0000 (22:24 -0800)] 
add system config options for success / failure levels to write blocking / non-blocking activations to db (#5169)

* add config option to disable successful non-blocking activation writes to db

* fix check

* feedback

* fix tests

* rebase

* feedback

* update config precedence

* Apply suggestions from code review

Co-authored-by: rodric rabbah <rodric@gmail.com>
Co-authored-by: Brendan Doyle <brendand@qualtrics.com>
Co-authored-by: rodric rabbah <rodric@gmail.com>
8 months ago[New Scheduler] Implement FPCInvokerReactive (#5125)
ningyougang [Thu, 13 Jan 2022 08:17:21 +0000 (16:17 +0800)] 
[New Scheduler] Implement FPCInvokerReactive (#5125)

* Implement FPCInvokerReactive

* Fix review points

* Remove unnecessary code

8 months agoUpdate main method of the scheduler. (#5157)
Dominic Kim [Thu, 13 Jan 2022 08:15:05 +0000 (17:15 +0900)] 
Update main method of the scheduler. (#5157)

8 months agoAdd FPC Load Balancer (#5192)
Dominic Kim [Thu, 13 Jan 2022 08:14:55 +0000 (17:14 +0900)] 
Add FPC Load Balancer (#5192)

* Add FPC pool balancer

* Deploy etcd for tests

* Apply scalaFmt

* Remove a redundant line.

* Update core/controller/src/main/scala/org/apache/openwhisk/core/loadBalancer/FPCPoolBalancer.scala

Update comments

Co-authored-by: Brendan Doyle <bdoyle0182@gmail.com>
* Update core/controller/src/main/scala/org/apache/openwhisk/core/loadBalancer/FPCPoolBalancer.scala

Co-authored-by: Brendan Doyle <bdoyle0182@gmail.com>
* Update core/controller/src/main/scala/org/apache/openwhisk/core/loadBalancer/FPCPoolBalancer.scala

Co-authored-by: Brendan Doyle <bdoyle0182@gmail.com>
* Update core/controller/src/main/scala/org/apache/openwhisk/core/loadBalancer/FPCPoolBalancer.scala

Co-authored-by: Brendan Doyle <bdoyle0182@gmail.com>
* Update core/controller/src/main/scala/org/apache/openwhisk/core/loadBalancer/FPCPoolBalancer.scala

Co-authored-by: Brendan Doyle <bdoyle0182@gmail.com>
* Apply comments.

Co-authored-by: Brendan Doyle <bdoyle0182@gmail.com>
9 months agoFix links in Issue and PR Template (#5186)
Dan Klco [Fri, 17 Dec 2021 15:21:05 +0000 (10:21 -0500)] 
Fix links in Issue and PR Template (#5186)

* Fixing links to the openwhisk website

* Fixing a link to the style guide as well

11 months agodocker creds in build-specific directory (#5167)
David Grove [Thu, 14 Oct 2021 13:05:20 +0000 (09:05 -0400)] 
docker creds in build-specific directory (#5167)

11 months agoUpdate README.md (#5165)
David Grove [Thu, 7 Oct 2021 13:54:15 +0000 (09:54 -0400)] 
Update README.md (#5165)

fix travis URL

11 months agoReflect decision to drop support for runtime-ballerina (#5164)
David Grove [Thu, 7 Oct 2021 02:26:59 +0000 (22:26 -0400)] 
Reflect decision to drop support for runtime-ballerina (#5164)

12 months agofinish/failed uncompleted transaction (#5138)
jiangpch [Thu, 30 Sep 2021 09:22:37 +0000 (17:22 +0800)] 
finish/failed uncompleted transaction (#5138)

12 months agoremove swift:4.2 (#5160)
David Grove [Sat, 25 Sep 2021 15:15:14 +0000 (11:15 -0400)] 
remove swift:4.2 (#5160)

13 months ago[New Scheduler] Add memory queue for the new scheduler (#5110)
Dominic Kim [Mon, 30 Aug 2021 01:09:21 +0000 (10:09 +0900)] 
[New Scheduler] Add memory queue for the new scheduler (#5110)

* Add SchedulingDecisionMaker

* Add AverageRingBuffer to calculate the average execution time.

* Add MemoryQueue

* Remove the duplicate comment.

* Apply comments

* Explicitly export the scala version

* Explicitly export the scala version

* Use dotted expression.

* Revert the scala version env

* Add kryo dependency.

* Fix import issues.

* Fix import issues.

* Remove duplicated codes

* Update codes according to the new akka version.

* Apply review comments.

* Fix test case

* Change kryo serialization library

* Remove kryo

* Remove empty newline

* Add altoo kryo serialization library

* Change the kryo serializer implementation

* Fix test cases

13 months agoAccept non-standard status codes. (#5149)
rodric rabbah [Mon, 23 Aug 2021 01:15:50 +0000 (21:15 -0400)] 
Accept non-standard status codes. (#5149)

13 months agoupgrade to nginx 1.21.1 (#5152)
David Grove [Fri, 20 Aug 2021 13:10:56 +0000 (09:10 -0400)] 
upgrade to nginx 1.21.1 (#5152)

13 months agominor version bump of azure-storage-blob to fix builds (#5150)
David Grove [Tue, 17 Aug 2021 09:51:11 +0000 (05:51 -0400)] 
minor version bump of azure-storage-blob to fix builds (#5150)

It appears the version 12.6.0 of com.azure:azure-storage-blob has
been removed from the maven central repo.  Our builds have been failing
for about 3 days trying to download it.  Version 12.7.0 is available,
so hack around the build problems by upgrading on minor version.

A typical failing build is: https://app.travis-ci.com/github/apache/openwhisk-runtime-rust/jobs/531822834#L279

13 months agoupdate name for Python 3 image (#5148)
David Grove [Fri, 13 Aug 2021 16:38:44 +0000 (12:38 -0400)] 
update name for Python 3 image (#5148)

We changed the image name we use to publish on dockerhub
from actionloop-python-v3.7 to action-python-v3.7
and forgot to update runtime.json to match.

13 months agoremove previously deprecated nodejs:10 and go:1.11 kinds (#5147)
David Grove [Thu, 12 Aug 2021 20:24:32 +0000 (16:24 -0400)] 
remove previously deprecated nodejs:10 and go:1.11 kinds (#5147)

14 months agocleanup: remove obsolete mesos configuration (#5144)
David Grove [Tue, 27 Jul 2021 16:12:31 +0000 (12:12 -0400)] 
cleanup: remove obsolete mesos configuration (#5144)

14 months agodon't log a uuid of the username portion of basic auth info (#5142)
David Grove [Wed, 21 Jul 2021 17:32:09 +0000 (13:32 -0400)] 
don't log a uuid of the username portion of basic auth info (#5142)

14 months agomodules.md: travis-ci.org -> travis-ci.com migration (#5139)
David Grove [Tue, 6 Jul 2021 20:50:22 +0000 (16:50 -0400)] 
modules.md: travis-ci.org -> travis-ci.com migration (#5139)

14 months agoDisable StandaloneKCFTests (#5140)
David Grove [Tue, 6 Jul 2021 20:17:08 +0000 (16:17 -0400)] 
Disable StandaloneKCFTests (#5140)

The only test case being run (invoke a blocking action
and get a result) fails quite frequently when run in
a travis-ci environment.  It appears we usually hit the
60 second timeout and return a 202 with the activation id
instead of the expected result.  This is "ok", but the test
is not prepared to handle it.

An alternative would be to modify the test to also accept a 202
response and then poll until the result was available, but that
would take significantly more work.