mirror of
https://codeberg.org/superseriousbusiness/gotosocial.git
synced 2024-12-27 03:18:16 +03:00
acc333c40b
When GTS is running in a container runtime which has configured CPU or memory limits or under an init system that uses cgroups to impose CPU and memory limits the values the Go runtime sees for GOMAXPROCS and GOMEMLIMIT are still based on the host resources, not the cgroup. At least for the throttling middlewares which use GOMAXPROCS to configure their queue size, this can result in GTS running with values too big compared to the resources that will actuall be available to it. This introduces 2 dependencies which can pick up resource contraints from the current cgroup and tune the Go runtime accordingly. This should result in the different queues being appropriately sized and in general more predictable performance. These dependencies are a no-op on non-Linux systems or if running in a cgroup that doesn't set a limit on CPU or memory. The automatic tuning of GOMEMLIMIT can be disabled by either explicitly setting GOMEMLIMIT yourself or by setting AUTOMEMLIMIT=off. The automatic tuning of GOMAXPROCS can similarly be counteracted by setting GOMAXPROCS yourself.
169 lines
8.7 KiB
Go
169 lines
8.7 KiB
Go
// Protocol Buffers for Go with Gadgets
|
|
//
|
|
// Copyright (c) 2013, The GoGo Authors. All rights reserved.
|
|
// http://github.com/gogo/protobuf
|
|
//
|
|
// Redistribution and use in source and binary forms, with or without
|
|
// modification, are permitted provided that the following conditions are
|
|
// met:
|
|
//
|
|
// * Redistributions of source code must retain the above copyright
|
|
// notice, this list of conditions and the following disclaimer.
|
|
// * Redistributions in binary form must reproduce the above
|
|
// copyright notice, this list of conditions and the following disclaimer
|
|
// in the documentation and/or other materials provided with the
|
|
// distribution.
|
|
//
|
|
// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
|
|
// "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
|
|
// LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
|
|
// A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
|
|
// OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
|
|
// SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
|
|
// LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
|
|
// DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
|
|
// THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
|
|
// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
|
|
// OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
|
|
|
|
/*
|
|
Package gogoproto provides extensions for protocol buffers to achieve:
|
|
|
|
- fast marshalling and unmarshalling.
|
|
- peace of mind by optionally generating test and benchmark code.
|
|
- more canonical Go structures.
|
|
- less typing by optionally generating extra helper code.
|
|
- goprotobuf compatibility
|
|
|
|
More Canonical Go Structures
|
|
|
|
A lot of time working with a goprotobuf struct will lead you to a place where you create another struct that is easier to work with and then have a function to copy the values between the two structs.
|
|
You might also find that basic structs that started their life as part of an API need to be sent over the wire. With gob, you could just send it. With goprotobuf, you need to make a parallel struct.
|
|
Gogoprotobuf tries to fix these problems with the nullable, embed, customtype and customname field extensions.
|
|
|
|
- nullable, if false, a field is generated without a pointer (see warning below).
|
|
- embed, if true, the field is generated as an embedded field.
|
|
- customtype, It works with the Marshal and Unmarshal methods, to allow you to have your own types in your struct, but marshal to bytes. For example, custom.Uuid or custom.Fixed128
|
|
- customname (beta), Changes the generated fieldname. This is especially useful when generated methods conflict with fieldnames.
|
|
- casttype (beta), Changes the generated fieldtype. All generated code assumes that this type is castable to the protocol buffer field type. It does not work for structs or enums.
|
|
- castkey (beta), Changes the generated fieldtype for a map key. All generated code assumes that this type is castable to the protocol buffer field type. Only supported on maps.
|
|
- castvalue (beta), Changes the generated fieldtype for a map value. All generated code assumes that this type is castable to the protocol buffer field type. Only supported on maps.
|
|
|
|
Warning about nullable: According to the Protocol Buffer specification, you should be able to tell whether a field is set or unset. With the option nullable=false this feature is lost, since your non-nullable fields will always be set. It can be seen as a layer on top of Protocol Buffers, where before and after marshalling all non-nullable fields are set and they cannot be unset.
|
|
|
|
Let us look at:
|
|
|
|
github.com/gogo/protobuf/test/example/example.proto
|
|
|
|
for a quicker overview.
|
|
|
|
The following message:
|
|
|
|
package test;
|
|
|
|
import "github.com/gogo/protobuf/gogoproto/gogo.proto";
|
|
|
|
message A {
|
|
optional string Description = 1 [(gogoproto.nullable) = false];
|
|
optional int64 Number = 2 [(gogoproto.nullable) = false];
|
|
optional bytes Id = 3 [(gogoproto.customtype) = "github.com/gogo/protobuf/test/custom.Uuid", (gogoproto.nullable) = false];
|
|
}
|
|
|
|
Will generate a go struct which looks a lot like this:
|
|
|
|
type A struct {
|
|
Description string
|
|
Number int64
|
|
Id github_com_gogo_protobuf_test_custom.Uuid
|
|
}
|
|
|
|
You will see there are no pointers, since all fields are non-nullable.
|
|
You will also see a custom type which marshals to a string.
|
|
Be warned it is your responsibility to test your custom types thoroughly.
|
|
You should think of every possible empty and nil case for your marshaling, unmarshaling and size methods.
|
|
|
|
Next we will embed the message A in message B.
|
|
|
|
message B {
|
|
optional A A = 1 [(gogoproto.nullable) = false, (gogoproto.embed) = true];
|
|
repeated bytes G = 2 [(gogoproto.customtype) = "github.com/gogo/protobuf/test/custom.Uint128", (gogoproto.nullable) = false];
|
|
}
|
|
|
|
See below that A is embedded in B.
|
|
|
|
type B struct {
|
|
A
|
|
G []github_com_gogo_protobuf_test_custom.Uint128
|
|
}
|
|
|
|
Also see the repeated custom type.
|
|
|
|
type Uint128 [2]uint64
|
|
|
|
Next we will create a custom name for one of our fields.
|
|
|
|
message C {
|
|
optional int64 size = 1 [(gogoproto.customname) = "MySize"];
|
|
}
|
|
|
|
See below that the field's name is MySize and not Size.
|
|
|
|
type C struct {
|
|
MySize *int64
|
|
}
|
|
|
|
The is useful when having a protocol buffer message with a field name which conflicts with a generated method.
|
|
As an example, having a field name size and using the sizer plugin to generate a Size method will cause a go compiler error.
|
|
Using customname you can fix this error without changing the field name.
|
|
This is typically useful when working with a protocol buffer that was designed before these methods and/or the go language were avialable.
|
|
|
|
Gogoprotobuf also has some more subtle changes, these could be changed back:
|
|
|
|
- the generated package name for imports do not have the extra /filename.pb,
|
|
but are actually the imports specified in the .proto file.
|
|
|
|
Gogoprotobuf also has lost some features which should be brought back with time:
|
|
|
|
- Marshalling and unmarshalling with reflect and without the unsafe package,
|
|
this requires work in pointer_reflect.go
|
|
|
|
Why does nullable break protocol buffer specifications:
|
|
|
|
The protocol buffer specification states, somewhere, that you should be able to tell whether a
|
|
field is set or unset. With the option nullable=false this feature is lost,
|
|
since your non-nullable fields will always be set. It can be seen as a layer on top of
|
|
protocol buffers, where before and after marshalling all non-nullable fields are set
|
|
and they cannot be unset.
|
|
|
|
Goprotobuf Compatibility:
|
|
|
|
Gogoprotobuf is compatible with Goprotobuf, because it is compatible with protocol buffers.
|
|
Gogoprotobuf generates the same code as goprotobuf if no extensions are used.
|
|
The enumprefix, getters and stringer extensions can be used to remove some of the unnecessary code generated by goprotobuf:
|
|
|
|
- gogoproto_import, if false, the generated code imports github.com/golang/protobuf/proto instead of github.com/gogo/protobuf/proto.
|
|
- goproto_enum_prefix, if false, generates the enum constant names without the messagetype prefix
|
|
- goproto_enum_stringer (experimental), if false, the enum is generated without the default string method, this is useful for rather using enum_stringer, or allowing you to write your own string method.
|
|
- goproto_getters, if false, the message is generated without get methods, this is useful when you would rather want to use face
|
|
- goproto_stringer, if false, the message is generated without the default string method, this is useful for rather using stringer, or allowing you to write your own string method.
|
|
- goproto_extensions_map (beta), if false, the extensions field is generated as type []byte instead of type map[int32]proto.Extension
|
|
- goproto_unrecognized (beta), if false, XXX_unrecognized field is not generated. This is useful in conjunction with gogoproto.nullable=false, to generate structures completely devoid of pointers and reduce GC pressure at the cost of losing information about unrecognized fields.
|
|
- goproto_registration (beta), if true, the generated files will register all messages and types against both gogo/protobuf and golang/protobuf. This is necessary when using third-party packages which read registrations from golang/protobuf (such as the grpc-gateway).
|
|
|
|
Less Typing and Peace of Mind is explained in their specific plugin folders godoc:
|
|
|
|
- github.com/gogo/protobuf/plugin/<extension_name>
|
|
|
|
If you do not use any of these extension the code that is generated
|
|
will be the same as if goprotobuf has generated it.
|
|
|
|
The most complete way to see examples is to look at
|
|
|
|
github.com/gogo/protobuf/test/thetest.proto
|
|
|
|
Gogoprototest is a seperate project,
|
|
because we want to keep gogoprotobuf independent of goprotobuf,
|
|
but we still want to test it thoroughly.
|
|
|
|
*/
|
|
package gogoproto
|