Files
mgmt/docs/style-guide.md
James Shubin 96dccca475 lang: Add module imports and more
This enables imports in mcl code, and is one of last remaining blockers
to using mgmt. Now we can start writing standalone modules, and adding
standard library functions as needed. There's still lots to do, but this
was a big missing piece. It was much harder to get right than I had
expected, but I think it's solid!

This unfortunately large commit is the result of some wild hacking I've
been doing for the past little while. It's the result of a rebase that
broke many "wip" commits that tracked my private progress, into
something that's not gratuitously messy for our git logs. Since this was
a learning and discovery process for me, I've "erased" the confusing git
history that wouldn't have helped. I'm happy to discuss the dead-ends,
and a small portion of that code was even left in for possible future
use.

This patch includes:

* A change to the cli interface:
You now specify the front-end explicitly, instead of leaving it up to
the front-end to decide when to "activate". For example, instead of:

mgmt run --lang code.mcl

we now do:

mgmt run lang --lang code.mcl

We might rename the --lang flag in the future to avoid the awkward word
repetition. Suggestions welcome, but I'm considering "input". One
side-effect of this change, is that flags which are "engine" specific
now must be specified with "run" before the front-end name. Eg:

mgmt run --tmp-prefix lang --lang code.mcl

instead of putting --tmp-prefix at the end. We also changed the GAPI
slightly, but I've patched all code that used it. This also makes things
consistent with the "deploy" command.

* The deploys are more robust and let you deploy after a run
This has been vastly improved and let's mgmt really run as a smart
engine that can handle different workloads. If you don't want to deploy
when you've started with `run` or if one comes in, you can use the
--no-watch-deploy option to block new deploys.

* The import statement exists and works!
We now have a working `import` statement. Read the docs, and try it out.
I think it's quite elegant how it fits in with `SetScope`. Have a look.
As a result, we now have some built-in functions available in modules.
This also adds the metadata.yaml entry-point for all modules. Have a
look at the examples or the tests. The bulk of the patch is to support
this.

* Improved lang input parsing code:
I re-wrote the parsing that determined what ran when we passed different
things to --lang. Deciding between running an mcl file or raw code is
now handled in a more intelligent, and re-usable way. See the inputs.go
file if you want to have a look. One casualty is that you can't stream
code from stdin *directly* to the front-end, it's encapsulated into a
deploy first. You can still use stdin though! I doubt anyone will notice
this change.

* The scope was extended to include functions and classes:
Go forth and import lovely code. All these exist in scopes now, and can
be re-used!

* Function calls actually use the scope now. Glad I got this sorted out.

* There is import cycle detection for modules!
Yes, this is another dag. I think that's #4. I guess they're useful.

* A ton of tests and new test infra was added!
This should make it much easier to add new tests that run mcl code. Have
a look at TestAstFunc1 to see how to add more of these.

As usual, I'll try to keep these commits smaller in the future!
2018-12-21 06:22:12 -05:00

6.3 KiB

Style guide

This document aims to be a reference for the desired style for patches to mgmt, and the associated mcl language. In particular it describes conventions which are not officially enforced by tools and in test cases, or that aren't clearly defined elsewhere. We try to turn as many of these into automated tests as we can. If something here is not defined in a test, or you think it should be, please write one! Even better, you can write a tool to automatically fix it, since this is more useful and can easily be turned into a test!

Overview for golang code

Most style issues are enforced by the gofmt tool. Other style aspects are often common sense to seasoned programmers, and we hope this will be a useful reference for new programmers.

There are a lot of useful code review comments described here. We don't necessarily follow everything strictly, but it is in general a very good guide.

Basics

  • All of our golang code is formatted with gofmt.

Comments

All of our code is commented with the minimums required for godoc to function, and so that our comments pass golint. Code comments should either be full sentences (which end with a period, use proper punctuation, and capitalize the first word when it is not a lower cased identifier), or are short one-line comments in the source which are not full sentences and don't end with a period.

They should explain algorithms, describe non-obvious behaviour, or situations which would otherwise need explanation or additional research during a code review. Notes about use of unfamiliar API's is a good idea for a code comment.

Example

Here you can see a function with the correct godoc string. The first word must match the name of the function. It is not capitalized because the function is private.

// square multiplies the input integer by itself and returns this product.
func square(x int) int {
	return x * x // we don't care about overflow errors
}

Line length

In general we try to stick to 80 character lines when it is appropriate. It is almost always appropriate for function godoc comments and most longer paragraphs. Exceptions are always allowed based on the will of the maintainer.

It is usually better to exceed 80 characters than to break code unnecessarily. If your code often exceeds 80 characters, it might be an indication that it needs refactoring.

Occasionally inline, two line source code comments are used within a function. These should usually be balanced so that you don't have one line with 78 characters and the second with only four. Split the comment between the two.

Method receiver naming

Contrary to the specialized naming of the method receiver variable, we usually name all of these obj for ease of code copying throughout the project, and for faster identification when reviewing code. Some anecdotal studies have shown that it makes the code easier to read since you don't need to remember the name of the method receiver variable in each different method. This is very similar to what is done in python.

Example

// Bar does a thing, and returns the number of baz results found in our
database.
func (obj *Foo) Bar(baz string) int {
	if len(obj.s) > 0 {
		return strings.Count(obj.s, baz)
	}
	return -1
}

Consistent ordering

In general we try to preserve a logical ordering in source files which usually matches the common order of execution that a lazy evaluator would follow.

This is also the order which is recommended when creating interface types. When implementing an interface, arrange your methods in the same order that they are declared in the interface.

When implementing code for the various types in the language, please follow this order: bool, str, int, float, list, map, struct, func.

Overview for mcl code

The mcl language is quite new, so this guide will probably change over time as we find what's best, and hopefully we'll be able to add an mclfmt tool in the future so that less of this needs to be documented. (Patches welcome!)

Indentation

Code indentation is done with tabs. The tab-width is a private preference, which is the beauty of using tabs: you can have your own personal preference. The inventor of mgmt uses and recommends a width of eight, and that is what should be used if your tool requires a modeline to be publicly committed.

Line length

We recommend you stick to 80 char line width. If you find yourself with deeper nesting, it might be a hint that your code could be refactored in a more pleasant way.

Capitalization

At the moment, variables, function names, and classes are all lowercase and do not contain underscores. We will probably figure out what style to recommend when the language is a bit further along. For example, we haven't decided if we should have a notion of public and private variables, and if we'd like to reserve capitalization for this situation.

Module naming

We recommend you name your modules with an mgmt- prefix. For example, a module about bananas might be named mgmt-banana. This is helpful for the useful magic built-in to the module import code, which will by default take a remote import like: import "https://github.com/purpleidea/mgmt-banana/" and namespace it as banana. Of course you can always pick the namespace yourself on import with: import "https://github.com/purpleidea/mgmt-banana/" as tomato or something similar.

Licensing

We believe that sharing code helps reduce unnecessary re-invention, so that we can stand on the shoulders of giants and hopefully make faster progress in science, medicine, exploration, etc... As a result, we recommend releasing your modules under the LGPLv3+ license for the maximum balance of freedom and re-usability. We strongly oppose any CLA requirements and believe that the "inbound==outbound" rule applies. Lastly, we do not support software patents and we hope you don't either!

Suggestions

If you have any ideas for suggestions or other improvements to this guide, please let us know!