This enables imports in mcl code, and is one of last remaining blockers to using mgmt. Now we can start writing standalone modules, and adding standard library functions as needed. There's still lots to do, but this was a big missing piece. It was much harder to get right than I had expected, but I think it's solid! This unfortunately large commit is the result of some wild hacking I've been doing for the past little while. It's the result of a rebase that broke many "wip" commits that tracked my private progress, into something that's not gratuitously messy for our git logs. Since this was a learning and discovery process for me, I've "erased" the confusing git history that wouldn't have helped. I'm happy to discuss the dead-ends, and a small portion of that code was even left in for possible future use. This patch includes: * A change to the cli interface: You now specify the front-end explicitly, instead of leaving it up to the front-end to decide when to "activate". For example, instead of: mgmt run --lang code.mcl we now do: mgmt run lang --lang code.mcl We might rename the --lang flag in the future to avoid the awkward word repetition. Suggestions welcome, but I'm considering "input". One side-effect of this change, is that flags which are "engine" specific now must be specified with "run" before the front-end name. Eg: mgmt run --tmp-prefix lang --lang code.mcl instead of putting --tmp-prefix at the end. We also changed the GAPI slightly, but I've patched all code that used it. This also makes things consistent with the "deploy" command. * The deploys are more robust and let you deploy after a run This has been vastly improved and let's mgmt really run as a smart engine that can handle different workloads. If you don't want to deploy when you've started with `run` or if one comes in, you can use the --no-watch-deploy option to block new deploys. * The import statement exists and works! We now have a working `import` statement. Read the docs, and try it out. I think it's quite elegant how it fits in with `SetScope`. Have a look. As a result, we now have some built-in functions available in modules. This also adds the metadata.yaml entry-point for all modules. Have a look at the examples or the tests. The bulk of the patch is to support this. * Improved lang input parsing code: I re-wrote the parsing that determined what ran when we passed different things to --lang. Deciding between running an mcl file or raw code is now handled in a more intelligent, and re-usable way. See the inputs.go file if you want to have a look. One casualty is that you can't stream code from stdin *directly* to the front-end, it's encapsulated into a deploy first. You can still use stdin though! I doubt anyone will notice this change. * The scope was extended to include functions and classes: Go forth and import lovely code. All these exist in scopes now, and can be re-used! * Function calls actually use the scope now. Glad I got this sorted out. * There is import cycle detection for modules! Yes, this is another dag. I think that's #4. I guess they're useful. * A ton of tests and new test infra was added! This should make it much easier to add new tests that run mcl code. Have a look at TestAstFunc1 to see how to add more of these. As usual, I'll try to keep these commits smaller in the future!
6.3 KiB
Style guide
This document aims to be a reference for the desired style for patches to mgmt,
and the associated mcl language. In particular it describes conventions which
are not officially enforced by tools and in test cases, or that aren't clearly
defined elsewhere. We try to turn as many of these into automated tests as we
can. If something here is not defined in a test, or you think it should be,
please write one! Even better, you can write a tool to automatically fix it,
since this is more useful and can easily be turned into a test!
Overview for golang code
Most style issues are enforced by the gofmt tool. Other style aspects are
often common sense to seasoned programmers, and we hope this will be a useful
reference for new programmers.
There are a lot of useful code review comments described here. We don't necessarily follow everything strictly, but it is in general a very good guide.
Basics
- All of our golang code is formatted with
gofmt.
Comments
All of our code is commented with the minimums required for godoc to function,
and so that our comments pass golint. Code comments should either be full
sentences (which end with a period, use proper punctuation, and capitalize the
first word when it is not a lower cased identifier), or are short one-line
comments in the source which are not full sentences and don't end with a period.
They should explain algorithms, describe non-obvious behaviour, or situations which would otherwise need explanation or additional research during a code review. Notes about use of unfamiliar API's is a good idea for a code comment.
Example
Here you can see a function with the correct godoc string. The first word must
match the name of the function. It is not capitalized because the function is
private.
// square multiplies the input integer by itself and returns this product.
func square(x int) int {
return x * x // we don't care about overflow errors
}
Line length
In general we try to stick to 80 character lines when it is appropriate. It is
almost always appropriate for function godoc comments and most longer
paragraphs. Exceptions are always allowed based on the will of the maintainer.
It is usually better to exceed 80 characters than to break code unnecessarily. If your code often exceeds 80 characters, it might be an indication that it needs refactoring.
Occasionally inline, two line source code comments are used within a function. These should usually be balanced so that you don't have one line with 78 characters and the second with only four. Split the comment between the two.
Method receiver naming
Contrary
to the specialized naming of the method receiver variable, we usually name all
of these obj for ease of code copying throughout the project, and for faster
identification when reviewing code. Some anecdotal studies have shown that it
makes the code easier to read since you don't need to remember the name of the
method receiver variable in each different method. This is very similar to what
is done in python.
Example
// Bar does a thing, and returns the number of baz results found in our
database.
func (obj *Foo) Bar(baz string) int {
if len(obj.s) > 0 {
return strings.Count(obj.s, baz)
}
return -1
}
Consistent ordering
In general we try to preserve a logical ordering in source files which usually matches the common order of execution that a lazy evaluator would follow.
This is also the order which is recommended when creating interface types. When implementing an interface, arrange your methods in the same order that they are declared in the interface.
When implementing code for the various types in the language, please follow this
order: bool, str, int, float, list, map, struct, func.
Overview for mcl code
The mcl language is quite new, so this guide will probably change over time as
we find what's best, and hopefully we'll be able to add an mclfmt tool in the
future so that less of this needs to be documented. (Patches welcome!)
Indentation
Code indentation is done with tabs. The tab-width is a private preference, which
is the beauty of using tabs: you can have your own personal preference. The
inventor of mgmt uses and recommends a width of eight, and that is what should
be used if your tool requires a modeline to be publicly committed.
Line length
We recommend you stick to 80 char line width. If you find yourself with deeper nesting, it might be a hint that your code could be refactored in a more pleasant way.
Capitalization
At the moment, variables, function names, and classes are all lowercase and do not contain underscores. We will probably figure out what style to recommend when the language is a bit further along. For example, we haven't decided if we should have a notion of public and private variables, and if we'd like to reserve capitalization for this situation.
Module naming
We recommend you name your modules with an mgmt- prefix. For example, a module
about bananas might be named mgmt-banana. This is helpful for the useful magic
built-in to the module import code, which will by default take a remote import
like: import "https://github.com/purpleidea/mgmt-banana/" and namespace it as
banana. Of course you can always pick the namespace yourself on import with:
import "https://github.com/purpleidea/mgmt-banana/" as tomato or something
similar.
Licensing
We believe that sharing code helps reduce unnecessary re-invention, so that we can stand on the shoulders of giants and hopefully make faster progress in science, medicine, exploration, etc... As a result, we recommend releasing your modules under the LGPLv3+ license for the maximum balance of freedom and re-usability. We strongly oppose any CLA requirements and believe that the "inbound==outbound" rule applies. Lastly, we do not support software patents and we hope you don't either!
Suggestions
If you have any ideas for suggestions or other improvements to this guide, please let us know!