Taylor R Campbell [Sat, 12 Jan 2019 00:05:34 +0000 (00:05 +0000)]
Don't leave the intermediate run-build shell process hanging around.
Taylor R Campbell [Fri, 11 Jan 2019 09:42:12 +0000 (09:42 +0000)]
Run the ChaCha self-tests too.
Taylor R Campbell [Fri, 11 Jan 2019 09:37:48 +0000 (09:37 +0000)]
Refuse to let the MD5 primitives run unless self-test passes.
Taylor R Campbell [Fri, 11 Jan 2019 09:36:56 +0000 (09:36 +0000)]
Fix buffer overflow in self-test. Derp.
This self-test was not used; there's a separate test in test-md5.scm
which is fine. (The result in this self-test is also correct -- it
just never got tested anywhere.)
Taylor R Campbell [Fri, 11 Jan 2019 09:36:00 +0000 (09:36 +0000)]
Fix byte ordering: encode state words in little-endian; don't memcpy!
How did I miss this earlier!?
Taylor R Campbell [Fri, 11 Jan 2019 08:35:19 +0000 (08:35 +0000)]
Exploit oddness to get bit-for-bit identical results on +/-.
Fixes test failure on NetBSD/powerpc:
;|logit-logistic-1/2/(.
2310585786300049 1.)| failed 1 sub-tests out of 1 in 0. seconds:
assertion 1: value was -.
23105857863000487 but expected an object = to -.
2310585786300049
Taylor R Campbell [Fri, 11 Jan 2019 06:35:27 +0000 (06:35 +0000)]
Use a much simpler endian-independent execute cache mechanism.
Requires no changes to the SVM1 byte code, so existing unlinked .com
files will continue to work (except for those created in the past
couple hours with my big-endian bodge that entailed no changes to the
little-endian hack), although built bands will confuse the microcode
because what cmpint stores in execute caches in memory changed.
- Before linking, an execution cache is simply the two words, as
before on little-endian systems:
<frame size> (fixnum)
<name> (symbol)
- After linking, the frame size remains untouched and the name is
replaced by the untagged address of the target:
<frame size> (fixnum)
<target> (untagged)
- INVOCATION:UUO-LINK now generates an (indirect-jump (pc-relative
<cache>)) instruction, which already does the right thing:
dereferences PC + offset to find a instruction address, and then
jumps to that address.
Taylor R Campbell [Fri, 11 Jan 2019 05:16:55 +0000 (05:16 +0000)]
Fix lambda-body -> scode-lambda-body straggler.
Taylor R Campbell [Fri, 11 Jan 2019 04:53:02 +0000 (04:53 +0000)]
Design big-endian uuo link execute caches.
The little-endian hack to overwrite the tag with instructions doesn't
work on big-endian because it's the datum, not the tag, that's at the
end of the word in the frame size.
There's no room for the instructions before anything here, so add
another word and move the frame size to the end. Kinda wasteful --
for that matter, it's not clear why we need to have any instructions
here at all, when we could just have INVOCATION:UUO-LINK compile to
an IJUMP instruction itself.
Taylor R Campbell [Fri, 11 Jan 2019 04:52:15 +0000 (04:52 +0000)]
Teach SVM back end how to assemble big-endian instruction streams.
Gotta do 'em backwards because the words are backwards in a bit
string on big-endian systems.
Taylor R Campbell [Fri, 11 Jan 2019 04:51:25 +0000 (04:51 +0000)]
Fix ordering of _words_ in fasumped bit strings on big-endian.
Apparently the byte order within a word affects the word order within
a bit string.
Taylor R Campbell [Fri, 11 Jan 2019 04:50:02 +0000 (04:50 +0000)]
Tweaks to make Edwin cross-compilable.
Taylor R Campbell [Fri, 11 Jan 2019 04:47:54 +0000 (04:47 +0000)]
Nothing architecturally limits powerpc to high memory.
Individual operating systems may, but none that I've encountered.
We may revisit this if we change SVM1 to always work in high memory.
Taylor R Campbell [Fri, 11 Jan 2019 04:45:19 +0000 (04:45 +0000)]
Use HOST_CC, default CC, to compile findprim.
This needs to run on the host system, not on the target system.
This way we can cross-compile the microcode if you have a C
cross-compiler handy, which makes iterating development a lot faster
when the target's native C compiler is painfully slow.
Taylor R Campbell [Thu, 10 Jan 2019 04:04:22 +0000 (04:04 +0000)]
Make powerpc floating-point exceptions fit in fixnums on 32-bit.
Taylor R Campbell [Thu, 10 Jan 2019 04:03:32 +0000 (04:03 +0000)]
Load with load-option so this gets LIARC bundles correctly.
Taylor R Campbell [Thu, 10 Jan 2019 04:03:21 +0000 (04:03 +0000)]
Mkdir lib/lib with -p in configure so it is idempotent.
Taylor R Campbell [Thu, 10 Jan 2019 04:01:57 +0000 (04:01 +0000)]
Disable constant-folding machine-dependent primitives in LIARC.
These are not valid across word size changes, but LIARC does not
expose compiler:cross-compiling?.
Taylor R Campbell [Thu, 10 Jan 2019 03:57:42 +0000 (03:57 +0000)]
One more round of rework for LIARC.
Keep the host actions and target actions separated by a stamp file as
with other cross-compilation.
Name the targets:
- cross-host does the actions on the host (some day, all of them),
and creates stamp_cross-host
- cross-target does the actions on the target, which all depend on
the host actions only through stamp_cross-host
- all does cross-host and then cross-target.
With any luck, this should preserve the behaviour of non-cross
builds.
Still missing: Makefile.tools doesn't work _from_ a system with LIARC
yet to cross-compile, because we have no way to build a fresh runtime
or create bundles outside the standard build.
=> We should not depend on a full fresh runtime, only on the macros.
=> We should have a way to link bundles. (For that matter, we should
have a notion of shared libraries that can be loaded independently
and with shared read-only physical memory, rather than as a bodgy
sequence of bands copying the data around.)
Chris Hanson [Wed, 9 Jan 2019 07:45:31 +0000 (23:45 -0800)]
Fix bug: characters with bucky bits not printing right.
Taylor R Campbell [Wed, 9 Jan 2019 03:49:39 +0000 (03:49 +0000)]
Avoid WRITE in URI->STRING.
We use this early on in loading an image -- before we have
initialized all the LIARC objects (indeed, in the course of
initializing LIARC objects), which may themselves have predicates in
the print method dispatcher.
Taylor R Campbell [Wed, 9 Jan 2019 03:49:23 +0000 (03:49 +0000)]
Restore printing strings in #[uri ...].
Taylor R Campbell [Wed, 9 Jan 2019 03:48:54 +0000 (03:48 +0000)]
Simplify pathnames for conversion to standard URIs to avoid dottiness.
Taylor R Campbell [Wed, 9 Jan 2019 03:48:30 +0000 (03:48 +0000)]
Use intermediate stamp for compinit.[ch] to avoid parallel clobber.
Taylor R Campbell [Wed, 9 Jan 2019 03:48:12 +0000 (03:48 +0000)]
Update liarc to modern debugging info/wrapper formats.
Taylor R Campbell [Wed, 9 Jan 2019 03:47:53 +0000 (03:47 +0000)]
Fix up makefile targets for liarc.
Taylor R Campbell [Wed, 9 Jan 2019 03:46:26 +0000 (03:46 +0000)]
NUL-terminate bytevectors too.
This shouldn't be necessary but we use these for primitive names with
routines that expect them to be NUL-terminated, so this is more
convenient until we either length-delimit the primitive names or
explicitly NUL-terminate them or whatever.
Taylor R Campbell [Wed, 9 Jan 2019 03:46:15 +0000 (03:46 +0000)]
Atomic write-to-temporary/rename-to-permanent so liarc is ^Cable.
Taylor R Campbell [Wed, 9 Jan 2019 03:45:35 +0000 (03:45 +0000)]
Use load-option so we get the LIARC bundle.
Taylor R Campbell [Tue, 8 Jan 2019 07:17:08 +0000 (07:17 +0000)]
Disable cross-compilation finishing stage for liarc.
Taylor R Campbell [Tue, 8 Jan 2019 06:48:47 +0000 (06:48 +0000)]
Don't build microcode in cross-host; build in cross-target.
Taylor R Campbell [Tue, 8 Jan 2019 06:06:46 +0000 (06:06 +0000)]
Suppress uninitialized variable warnings.
GCC is easily confused by the code we generate.
Taylor R Campbell [Tue, 8 Jan 2019 06:28:02 +0000 (06:28 +0000)]
Compile and link liarc objects as shared with no fatal warnings.
Taylor R Campbell [Tue, 8 Jan 2019 05:54:54 +0000 (05:54 +0000)]
Need to wait for runtime to compile before building liarc ucode.
Taylor R Campbell [Tue, 8 Jan 2019 05:38:38 +0000 (05:38 +0000)]
Teach stackify about bytevectors.
XXX Really it should use bytevectors as the basic type now, and we
should teach it about strings, but this is more expedient since it
was written when string == bytevector and mostly this works out.
Taylor R Campbell [Tue, 8 Jan 2019 05:19:14 +0000 (05:19 +0000)]
Teach the makefile how to make the .pkd files for liarc rules.
Taylor R Campbell [Tue, 8 Jan 2019 05:31:57 +0000 (05:31 +0000)]
Avoid compiler:cross-compiling? in liarc.
Taylor R Campbell [Wed, 9 Jan 2019 03:51:59 +0000 (03:51 +0000)]
Fix typo: SOS_BUILD_TARGETS, not SOS_TARGETS. Actually build SOS!
Taylor R Campbell [Tue, 8 Jan 2019 16:40:11 +0000 (16:40 +0000)]
Convert to SCHEME_OBJECT * first before subtracting membase.
This system (with or without the change) requires all addresses that
are tagged to be word-aligned, which expands the address space by a
factor of four on 32-bit systems, but means we can't tag pointers to
unaligned instruction addresses.
This means that i386 compiled code won't be able to take advantage of
membase, but it can't anyway without changes to the compiler, which
doesn't know about membase as is.
However, this _also_ means that multiclosures in SVM won't work
because only the first entry (and every four or eight entries) is
guaranteed to be word-aligned. We could address this by aligning the
entries, and maybe remove the ENTER-CLOSURE instruction overhead by
using indirection for entries like riastradh-
20181220-closentry-v3
does for amd64.
(Don't want to change CC_ENTRY_NEW_ADDRESS or anything because
there's an outstanding branch that changes them already for other
reasons.)
Taylor R Campbell [Tue, 8 Jan 2019 07:37:32 +0000 (07:37 +0000)]
Fix dependency ordering.
Taylor R Campbell [Tue, 8 Jan 2019 07:17:19 +0000 (07:17 +0000)]
Isolate directories for clean-compiler rule.
Taylor R Campbell [Tue, 8 Jan 2019 06:34:00 +0000 (06:34 +0000)]
Don't hang in non-parallel makes waiting for input.
Taylor R Campbell [Tue, 8 Jan 2019 05:23:23 +0000 (05:23 +0000)]
Fix stray backslash that was harmless without LIARC.
Taylor R Campbell [Tue, 8 Jan 2019 02:34:10 +0000 (02:34 +0000)]
Rework makefile to use intermediate variables, not rules.
This gives the opportunity for the variables to be files, not phony
rules, to limit rebuilds. Disadvantage: must be written in
dependency order because make expands variables in dependencies as it
reads them, not lazily. But this reduces the size of the makefile
quite a bit.
Use stamp_tools to trigger (incremental) rebuild of toolchain.
Chris Hanson [Tue, 8 Jan 2019 08:46:39 +0000 (00:46 -0800)]
Rewrite printing of #[...] forms, for simplicity now and later for sharing.
In order to properly implement datum labels for things inside of bracketed
forms, we need to be able to walk the items that are being printed there.
Previously this would have been very difficult since the insides of these forms
were printed by custom printers. Now they are exposed as individual objects
that can be walked.
Further work is necessary to include these objects when walking the tree.
Taylor R Campbell [Sun, 6 Jan 2019 04:17:06 +0000 (04:17 +0000)]
Integrate PROMISE?.
Small but measurable speed improvement, getting to diminishing
returns after a nearly 7x speed increase on promise-heavy stream
code.
Taylor R Campbell [Sun, 6 Jan 2019 04:01:32 +0000 (04:01 +0000)]
Try EQ? first before the passed-in equality procedure in MEMV &c.
- EQ? must imply the passed-in equality procedure anyway.
- EQ? is open-coded and quick.
- MEMV turns up hot in profiles of the compiler.
- Small but measurable performance improvement compiling the tests.
Taylor R Campbell [Sat, 5 Jan 2019 19:29:24 +0000 (19:29 +0000)]
Integrate GUARANTEE.
For this to be effective, SF makes the assumption that predicates do
not modify their own definitions, like
(define (foo? x) (set! foo? (lambda (x) x #f)) #t)
(guarantee foo? 42)
Such is the depravity of arbitrary side effects not represented in a
type system...!
Taylor R Campbell [Mon, 7 Jan 2019 06:42:18 +0000 (06:42 +0000)]
Fix format words generated by svm1 compiler for internal procedures.
Continuation parser relies on the next-continuation-offset for
internal procedures in interrupt frames.
Taylor R Campbell [Mon, 7 Jan 2019 05:27:38 +0000 (05:27 +0000)]
Configure outcome should not depend on whether lib/all.com exists!
This meant you got a different (and broken) build if you simply reran
configure, which is awfully confusing. Now we use the native release
marker to change the default behaviour of configure reliably.
What idiot did this, git blame? ...oh.
Taylor R Campbell [Mon, 7 Jan 2019 05:07:56 +0000 (05:07 +0000)]
Regenerate configure if out of date, not just if nonexistent.
Taylor R Campbell [Mon, 7 Jan 2019 03:53:09 +0000 (03:53 +0000)]
gitignore cross objects and Makefile.tools.
Taylor R Campbell [Mon, 7 Jan 2019 02:57:43 +0000 (02:57 +0000)]
Clean .nib, .ext, and .dkp too.
Taylor R Campbell [Mon, 7 Jan 2019 00:27:04 +0000 (00:27 +0000)]
Rework makefile for cross-compilation with a toolchain again.
We use Makefile.tools only if --enable-cross-compiling is true.
Everything it builds goes under tools/, or should if there are no
bugs -- even intermediate .bin, .com, &c., files.
New usage model does not require any external trees:
% ./configure --enable-cross-compiling --enable-native-code=i386
% make cross-host
% make all
However, the host must be a recent master with new CREF and SF
features for separate source and object roots, so we can't rely on
this to work until we cut a new release with those features.
(It shouldn't be necessary to run _anything_ on the target system,
but we're a ways away from that: we need the cross-compiler to be
able to cope with macros across subsystem dependencies, and we need a
`static' linker, not just a fasloader-and-disk-save.)
Taylor R Campbell [Mon, 7 Jan 2019 00:25:26 +0000 (00:25 +0000)]
Generate the trivial constructor in the objdir, not srcdir.
Define cref/source-root and cref/object-root in host-adapter.scm so
we can still load compiler.sf into old Schemes, which will never have
this distinction.
Taylor R Campbell [Sun, 6 Jan 2019 17:01:34 +0000 (17:01 +0000)]
Teach cref and sf about separate source and object directories.
Taylor R Campbell [Sun, 6 Jan 2019 23:17:58 +0000 (23:17 +0000)]
Expose fasl-format:x86-64 as another name for the amd64 format.
Relevant because MIT_SCHEME_NATIVE_CODE gets set to x86-64, and gets
plopped into `fasl-format:@MIT_SCHEME_NATIVE_CODE' in the makefile.
Chris Hanson [Mon, 7 Jan 2019 07:50:47 +0000 (23:50 -0800)]
Change identify-world to show a very brief summary.
* Remove versions from all of the subsystems, except the release.
* Remove microcode and runtime subsystems entirely.
Chris Hanson [Mon, 7 Jan 2019 07:32:15 +0000 (23:32 -0800)]
Generalize list-like printing, and support list-breadth limit properly.
Chris Hanson [Mon, 7 Jan 2019 00:32:57 +0000 (16:32 -0800)]
Clean up wording around bitless characters.
Chris Hanson [Mon, 7 Jan 2019 00:32:41 +0000 (16:32 -0800)]
Remove unused and unexported guarantee-FOO procedures.
Chris Hanson [Mon, 7 Jan 2019 00:19:59 +0000 (16:19 -0800)]
Change most places that use bitless-char? to just throw away the bucket bits.
Chris Hanson [Sun, 6 Jan 2019 06:58:28 +0000 (22:58 -0800)]
Do the annual copyright update.
Chris Hanson [Sun, 6 Jan 2019 06:56:22 +0000 (22:56 -0800)]
In update-copyright, replace use of old regexp with regsexp.
Also adjust the various filename patterns to reflect the current directory
structure.
Chris Hanson [Sun, 6 Jan 2019 06:41:18 +0000 (22:41 -0800)]
Clean the compiler subdir too.
Chris Hanson [Sun, 6 Jan 2019 02:28:40 +0000 (18:28 -0800)]
Allow alist->bundle to accept #F as predicate.
Also beef up bundle tests a bit.
Chris Hanson [Sun, 6 Jan 2019 02:12:26 +0000 (18:12 -0800)]
Fix problem with using bundle? as a bundle predicate.
Chris Hanson [Sun, 6 Jan 2019 01:52:10 +0000 (17:52 -0800)]
New printer parameter param:print-hash-number-in-objects?.
Chris Hanson [Sun, 6 Jan 2019 01:47:40 +0000 (17:47 -0800)]
Use dispatch-tag-print-name.
Chris Hanson [Sun, 6 Jan 2019 01:46:52 +0000 (17:46 -0800)]
Export dispatch-tag-print-name for convenience.
Chris Hanson [Sun, 6 Jan 2019 01:46:17 +0000 (17:46 -0800)]
Eliminate obsolete comment from user manual.
Chris Hanson [Fri, 4 Jan 2019 05:19:44 +0000 (00:19 -0500)]
Save file used to test gc table correctness.
Taylor R Campbell [Thu, 3 Jan 2019 16:35:11 +0000 (16:35 +0000)]
Detect trivial infinite recursion in promises.
Obviously this can be fooled, like
(force (let loop () (delay-force (loop))))
or any non-halting Turing machine, but this is an easy case to detect
with negligible cost.
Taylor R Campbell [Thu, 3 Jan 2019 16:33:31 +0000 (16:33 +0000)]
Test detectable screw case of delay-force infinite recursion.
Taylor R Campbell [Thu, 3 Jan 2019 16:23:05 +0000 (16:23 +0000)]
Integrate %promise-parts.
Shaves another 20% off time for test-promise.scm.
Taylor R Campbell [Thu, 3 Jan 2019 07:17:32 +0000 (07:17 +0000)]
Use another indirection for representation of promises.
The pairs never change, so merely loading the pair object from the
cell indirection gives us an atomic snapshot of it. This way, there
is no need for without-interrupts in promise-forced?.
This makes each promise cost one more word (previously: one word to
represent plus three words of heap space; now one word to represent
plus four words of heap space), but reducing without-interrupts is a
big win -- this halves the time of test-promise.scm on my machine.
Of course, on a parallel system, the without-interrupts in %force is
still not enough (and we'll need the cell-contentses to be
load-acquire operations, not just loads).
Taylor R Campbell [Thu, 3 Jan 2019 05:36:58 +0000 (05:36 +0000)]
Fix nested promises.
Taylor R Campbell [Thu, 3 Jan 2019 05:36:07 +0000 (05:36 +0000)]
Add promise tests. Nested promises are busted.
Taylor R Campbell [Thu, 3 Jan 2019 05:11:20 +0000 (05:11 +0000)]
Open-code cell operations.
Taylor R Campbell [Thu, 3 Jan 2019 16:10:04 +0000 (16:10 +0000)]
Restore sf predicates, not scode predicates.
Various parts of sf were silently disabled in the overly aggressive
change
commit
816b9122751c9b60b85f9ce3db0df8a516f763cb
Author: Chris Hanson <org/chris-hanson/cph>
Date: Wed Jan 24 00:07:59 2018 -0800
Greatly simplify SCode abstraction and change names to contain "scode".
Also remove all FOO-components and FOO-subexpressions procedures.
More work remains: the lambda abstraction is an unholy mess and needs to be
cleaned up. The scan-defines stuff also merits some consideration.
which kinda reflects on the sensibility of using disjoint type
predicates across domains like this as one does in Scheme.
Taylor R Campbell [Fri, 4 Jan 2019 06:59:33 +0000 (06:59 +0000)]
Merge branch 'cross-fasdump-v2'
- Introduces a portable fasdumper that the compiler can use for
cross-compiling.
- Adapt the build system to use it. This form is not final: we
should really be using GNU configure's build/host/target form.
- Fix up the i386 back end, particularly floating-point stuff.
- Split svm1 into four architectures: svm1-32be, svm1-32le,
svm1-64be, svm1-64le. This way you can, e.g., use your x86 laptop
to cross-build an svm1-32le system to run on an arm32 machine.
- Various minor other fixes for cross-compilation.
Taylor R Campbell [Fri, 4 Jan 2019 05:09:26 +0000 (05:09 +0000)]
Use integrated %dispatch-tag-ref in record type predicates.
These show up hot in profiles, so this makes a difference.
Taylor R Campbell [Fri, 4 Jan 2019 05:08:58 +0000 (05:08 +0000)]
Integrate string.scm operations in symbol.scm.
Integrating, e.g., cp1-ref makes a huge difference.
Chris Hanson [Fri, 4 Jan 2019 05:16:54 +0000 (00:16 -0500)]
Tweak equality-predicate-property to accept a default-value argument.
Chris Hanson [Fri, 4 Jan 2019 04:44:26 +0000 (23:44 -0500)]
Don't use general predicate relations for record predicates.
Chris Hanson [Wed, 2 Jan 2019 06:30:44 +0000 (01:30 -0500)]
Merge branch 'master' of git.sv.gnu.org:/srv/git/mit-scheme
Chris Hanson [Wed, 2 Jan 2019 06:30:06 +0000 (01:30 -0500)]
Fix problem with crashing in Emacs interface.
Taylor R Campbell [Wed, 2 Jan 2019 05:50:59 +0000 (05:50 +0000)]
Use runtime's string ports.
Also read file in one swell foop, rather than character by character
in a slow painful chain of indirections thousands of times slower.
We'll use legacy strings here because this code was all written under
the assumption that `string' meant byte vector, and legacy strings
still have that semantics.
Eventually this should all be adapted to use bytevectors instead for
storage, and interpret things as strings only as necessary for text
processing beyond mail data formats.
Taylor R Campbell [Wed, 2 Jan 2019 05:50:16 +0000 (05:50 +0000)]
Implement position for string input ports.
Taylor R Campbell [Wed, 2 Jan 2019 05:50:06 +0000 (05:50 +0000)]
Export binary-port-length too.
Taylor R Campbell [Sat, 8 Dec 2018 14:19:46 +0000 (14:19 +0000)]
Fix binary-port-position for output ports.
Not sure if it'll DTRT for combined i/o ports; need more tests!
Taylor R Campbell [Sat, 8 Dec 2018 14:10:14 +0000 (14:10 +0000)]
Export binary-port-position and set-binary-port-position!.
Currently busted for output ports.
Taylor R Campbell [Wed, 2 Jan 2019 02:16:36 +0000 (02:16 +0000)]
Integrate string operations for order of magnitude speedup.
Taylor R Campbell [Wed, 2 Jan 2019 02:16:28 +0000 (02:16 +0000)]
ucd-slc-value &c. return chars, not fixnums.
Taylor R Campbell [Sun, 30 Dec 2018 23:33:21 +0000 (23:33 +0000)]
Use 32-bit xor rather than 64-bit xor for zeroing.
Taylor R Campbell [Sat, 29 Dec 2018 21:56:47 +0000 (21:56 +0000)]
Split deeply nested expressions into named and typed temporaries.
No functional change intended, just makes stepping through with a
debugger easier.
Taylor R Campbell [Mon, 31 Dec 2018 21:41:51 +0000 (21:41 +0000)]
Fix misparenthesization.
Taylor R Campbell [Sat, 15 Dec 2018 03:21:44 +0000 (03:21 +0000)]
Confirm that a couple screw cases in closure analysis work.
Once upon a time the Y combinator and U combinator would crash the
compiler. It's been fixed now but let's at least immortalize the
code I had lying around that crashed it so it doesn't happen again.
Taylor R Campbell [Tue, 11 Dec 2018 16:40:51 +0000 (16:40 +0000)]
Add some more release notes.
Chris Hanson [Thu, 27 Dec 2018 21:22:32 +0000 (16:22 -0500)]
Fix whitespace change ignored by magit.