codon/stdlib/internal/builtin.codon

358 lines
8.1 KiB
Python
Raw Normal View History

Dynamic Polymorphism (#58) * Use Static[] for static inheritance * Support .seq extension * Fix #36 * Polymorphic typechecking; vtables [wip] * v-table dispatch [wip] * vtable routing [wip; bug] * vtable routing [MVP] * Fix texts * Add union type support * Update FAQs * Clarify * Add BSL license * Add makeUnion * Add IR UnionType * Update union representation in LLVM * Update README * Update README.md * Update README * Update README.md * Add benchmarks * Add more benchmarks and README * Add primes benchmark * Update benchmarks * Fix cpp * Clean up list * Update faq.md * Add binary trees benchmark * Add fannkuch benchmark * Fix paths * Add PyPy * Abort on fail * More benchmarks * Add cpp word_count * Update set_partition cpp * Add nbody cpp * Add TAQ cpp; fix word_count timing * Update CODEOWNERS * Update README * Update README.md * Update CODEOWNERS * Fix bench script * Update binary_trees.cpp * Update taq.cpp * Fix primes benchmark * Add mandelbrot benchmark * Fix OpenMP init * Add Module::unsafeGetUnionType * UnionType [wip] [skip ci] * Integrate IR unions and Union * UnionType refactor [skip ci] * Update README.md * Update docs * UnionType [wip] [skip ci] * UnionType and automatic unions * Add Slack * Update faq.md * Refactor types * New error reporting [wip] * New error reporting [wip] * peglib updates [wip] [skip_ci] * Fix parsing issues * Fix parsing issues * Fix error reporting issues * Make sure random module matches Python * Update releases.md * Fix tests * Fix #59 * Fix #57 * Fix #50 * Fix #49 * Fix #26; Fix #51; Fix #47; Fix #49 * Fix collection extension methods * Fix #62 * Handle *args/**kwargs with Callable[]; Fix #43 * Fix #43 * Fix Ptr.__sub__; Fix polymorphism issues * Add typeinfo * clang-format * Upgrade fmtlib to v9; Use CPM for fmtlib; format spec support; __format__ support * Use CPM for semver and toml++ * Remove extension check * Revamp str methods * Update str.zfill * Fix thunk crashes [wip] [skip_ci] * Fix str.__reversed__ * Fix count_with_max * Fix vtable memory allocation issues * Add poly AST tests * Use PDQsort when stability does not matter * Fix dotted imports; Fix issues * Fix kwargs passing to Python * Fix #61 * Fix #37 * Add isinstance support for unions; Union methods return Union type if different * clang-format * Nicely format error tracebacks * Fix build issues; clang-format * Fix OpenMP init * Fix OpenMP init * Update README.md * Fix tests * Update license [skip ci] * Update license [ci skip] * Add copyright header to all source files * Fix super(); Fix error recovery in ClassStmt * Clean up whitespace [ci skip] * Use Python 3.9 on CI * Print info in random test * Fix single unions * Update random_test.codon * Fix polymorhic thunk instantiation * Fix random test * Add operator.attrgetter and operator.methodcaller * Add code documentation * Update documentation * Update README.md * Fix tests * Fix random init Co-authored-by: A. R. Shajii <ars@ars.me>
2022-12-05 08:45:21 +08:00
# Copyright (C) 2022 Exaloop Inc. <https://exaloop.io>
2022-01-24 14:47:43 +08:00
2021-09-28 02:02:44 +08:00
from internal.gc import alloc_atomic, free
2022-02-16 23:51:16 +08:00
from internal.types.optional import unwrap
2021-09-28 02:02:44 +08:00
class object:
2022-10-23 08:53:25 +08:00
def __init__(self):
pass
2022-01-24 14:47:43 +08:00
def __repr__(self) -> str:
2022-10-23 08:53:25 +08:00
return f"<{self.__class__.__name__} object at {self.__raw__()}>"
2022-01-24 14:47:43 +08:00
def id(x) -> int:
2021-09-28 02:02:44 +08:00
if isinstance(x, ByRef):
return int(x.__raw__())
else:
return 0
_stdout = _C.seq_stdout()
2022-01-24 14:47:43 +08:00
2022-02-16 23:51:16 +08:00
def print(*args, sep: str = " ", end: str = "\n", file=_stdout, flush: bool = False):
2021-09-28 02:02:44 +08:00
"""
Print args to the text stream file.
"""
fp = cobj()
Typechecker refactoring (#20) * Initial refactor commit * Support external vars * Simplify refactor; Python scoping [wip] * Python scoping [wip] * Python scoping [fix loops; wip] * Fix lambdas * Python scoping [test fixes; wip] * Fix scoping [wip] * Fix basic tests [no-ci] * Fix tests * CallExpr refactoring [wip] * CallExpr refactoring [wip] * Remove activeUnbounds tracking * Add core.codon * Move Function and other core types to core.codon; Revamp Function and Callable types * Refactor IntExpr, FloatExpr and CallExpr * Refactor ClassStmt * Refactor context, IdExpr and DotExpr * Refactor DotExpr and AssignStmt * Refactor ImportStmt * Refactor FunctionStmt * Refactor * Remove UpdateStmt * Refactor AssignReplacementVisitor * Make SimplifyVisitor in-place * Fix new scoping * Fix import type alias handling * Add docstrings; Complete Simplify refactoring * Fixes for seqtest * Refactor typecheck [wip] * Refactor typecheck [wip] * Refactor typecheck/access; Remove void anduse NoneType; Fix #18 * Refactor typecheck/assign * clang-format and cmake-format * Fix none types in IR * Multi-error support in simplify * Fix IR tests for new void * Simplify ClassStmt * Refactor cond.cpp * Refactor error.cpp * Refactor function.cpp and simplify unbounds * Refactor op.cpp * Refactor call.cpp [wip] [no-ci] * seqassertn updates [noci] * Refactor call.cpp * Refactor call.cpp * Refactor call.cpp * Refactor typecheck * clang-tidy updates [noci] * Refactor infer.cpp [wip] * Refactor infer.cpp * Refactor wrapExpr * Remove visitedAsts * Remove old base logic * Refactor typecheck ctx * Fix JIT bug * Fix JIT tests * Scoping fixes [wip] [noci] * Fix ImperativeForFlow var store * Add newlines [noci] * Dump IR module with log flag * Fix scoping bugs; Add &, ^ and | static operations; Address stylistic review issues * Fix side effect analysis for for-loops * Add support for class variables and ClassVar * Refactor special dot-member cases * Add codon app tests * Fix class variables; clang-tidy * Fix __argv__ * Add datetime constants and update tests * Fix #25; Add Py_None, Py_True and Py_False; External var support [wip] * External var support [wip] * Dump LLVM IR when debug flags are active * clang-format * Fix arg var construction * Extern var fixes * Undo extern var changes related to stdout etc. * Fix tuple magics * Fix extern vars and tuple magics * Fix duplicate var name error * Fix extern vars * Fix #16 * Fix side-effect analysis for try-catch * Move test C var to test executable * Add staticmethod * Fix var status for try-catch * Fix tests * Fix shell var name * Fix test * Fix app test * Fix scoping issue (remove dominated identifier from stack) * Fix no-pie issue * Use PIC when building library object * Don't use -no-pie when building library [noci] * Use -relocation-model=pic in test * Fix lib build on Linux * Fix lib build * Update exceptions to use subclasses vs. header * Fix __repr__ * Fix tests * Fix exceptions test * Don't build docs Co-authored-by: A. R. Shajii <ars@ars.me>
2022-07-27 04:06:00 +08:00
if isinstance(file, cobj):
2021-09-28 02:02:44 +08:00
fp = file
else:
fp = file.fp
i = 0
for a in args:
if i and sep:
_C.seq_print_full(sep, fp)
_C.seq_print_full(str(a), fp)
i += 1
_C.seq_print_full(end, fp)
if flush:
_C.fflush(fp)
Dynamic Polymorphism (#58) * Use Static[] for static inheritance * Support .seq extension * Fix #36 * Polymorphic typechecking; vtables [wip] * v-table dispatch [wip] * vtable routing [wip; bug] * vtable routing [MVP] * Fix texts * Add union type support * Update FAQs * Clarify * Add BSL license * Add makeUnion * Add IR UnionType * Update union representation in LLVM * Update README * Update README.md * Update README * Update README.md * Add benchmarks * Add more benchmarks and README * Add primes benchmark * Update benchmarks * Fix cpp * Clean up list * Update faq.md * Add binary trees benchmark * Add fannkuch benchmark * Fix paths * Add PyPy * Abort on fail * More benchmarks * Add cpp word_count * Update set_partition cpp * Add nbody cpp * Add TAQ cpp; fix word_count timing * Update CODEOWNERS * Update README * Update README.md * Update CODEOWNERS * Fix bench script * Update binary_trees.cpp * Update taq.cpp * Fix primes benchmark * Add mandelbrot benchmark * Fix OpenMP init * Add Module::unsafeGetUnionType * UnionType [wip] [skip ci] * Integrate IR unions and Union * UnionType refactor [skip ci] * Update README.md * Update docs * UnionType [wip] [skip ci] * UnionType and automatic unions * Add Slack * Update faq.md * Refactor types * New error reporting [wip] * New error reporting [wip] * peglib updates [wip] [skip_ci] * Fix parsing issues * Fix parsing issues * Fix error reporting issues * Make sure random module matches Python * Update releases.md * Fix tests * Fix #59 * Fix #57 * Fix #50 * Fix #49 * Fix #26; Fix #51; Fix #47; Fix #49 * Fix collection extension methods * Fix #62 * Handle *args/**kwargs with Callable[]; Fix #43 * Fix #43 * Fix Ptr.__sub__; Fix polymorphism issues * Add typeinfo * clang-format * Upgrade fmtlib to v9; Use CPM for fmtlib; format spec support; __format__ support * Use CPM for semver and toml++ * Remove extension check * Revamp str methods * Update str.zfill * Fix thunk crashes [wip] [skip_ci] * Fix str.__reversed__ * Fix count_with_max * Fix vtable memory allocation issues * Add poly AST tests * Use PDQsort when stability does not matter * Fix dotted imports; Fix issues * Fix kwargs passing to Python * Fix #61 * Fix #37 * Add isinstance support for unions; Union methods return Union type if different * clang-format * Nicely format error tracebacks * Fix build issues; clang-format * Fix OpenMP init * Fix OpenMP init * Update README.md * Fix tests * Update license [skip ci] * Update license [ci skip] * Add copyright header to all source files * Fix super(); Fix error recovery in ClassStmt * Clean up whitespace [ci skip] * Use Python 3.9 on CI * Print info in random test * Fix single unions * Update random_test.codon * Fix polymorhic thunk instantiation * Fix random test * Add operator.attrgetter and operator.methodcaller * Add code documentation * Update documentation * Update README.md * Fix tests * Fix random init Co-authored-by: A. R. Shajii <ars@ars.me>
2022-12-05 08:45:21 +08:00
@extend
class __internal__:
def prn(*args):
print(*args)
2022-01-24 14:47:43 +08:00
2021-09-28 02:02:44 +08:00
def min(*args):
if staticlen(args) == 0:
raise ValueError("empty sequence")
elif staticlen(args) == 1 and hasattr(args[0], "__iter__"):
x = args[0].__iter__()
if not x.done():
s = x.next()
while not x.done():
i = x.next()
2022-01-24 14:47:43 +08:00
if i < s:
s = i
2021-09-28 02:02:44 +08:00
x.destroy()
return s
else:
x.destroy()
raise ValueError("empty sequence")
elif staticlen(args) == 2:
a, b = args
return a if a <= b else b
else:
m = args[0]
for i in args:
2022-01-24 14:47:43 +08:00
if i < m:
m = i
2021-09-28 02:02:44 +08:00
return m
def max(*args):
if staticlen(args) == 0:
raise ValueError("empty sequence")
elif staticlen(args) == 1 and hasattr(args[0], "__iter__"):
x = args[0].__iter__()
if not x.done():
s = x.next()
while not x.done():
i = x.next()
2022-01-24 14:47:43 +08:00
if i > s:
s = i
2021-09-28 02:02:44 +08:00
x.destroy()
return s
else:
x.destroy()
raise ValueError("empty sequence")
elif staticlen(args) == 2:
a, b = args
return a if a >= b else b
else:
m = args[0]
for i in args:
2022-01-24 14:47:43 +08:00
if i > m:
m = i
2021-09-28 02:02:44 +08:00
return m
2022-01-24 14:47:43 +08:00
def len(x) -> int:
2021-09-28 02:02:44 +08:00
"""
Return the length of x
"""
return x.__len__()
def iter(x):
"""
Return an iterator for the given object
"""
return x.__iter__()
def abs(x):
"""
Return the absolute value of x
"""
return x.__abs__()
2022-01-24 14:47:43 +08:00
def hash(x) -> int:
2021-09-28 02:02:44 +08:00
"""
Returns hashed value only for immutable objects
"""
return x.__hash__()
2022-01-24 14:47:43 +08:00
def ord(s: str) -> int:
2021-09-28 02:02:44 +08:00
"""
Return an integer representing the Unicode code point of s
"""
if len(s) != 1:
2022-01-24 14:47:43 +08:00
raise TypeError(
2022-02-16 23:51:16 +08:00
f"ord() expected a character, but string of length {len(s)} found"
2022-01-24 14:47:43 +08:00
)
2021-09-28 02:02:44 +08:00
return int(s.ptr[0])
2021-10-10 05:07:41 +08:00
def divmod(a, b):
if hasattr(a, "__divmod__"):
return a.__divmod__(b)
else:
return (a // b, a % b)
2022-01-24 14:47:43 +08:00
def chr(i: int) -> str:
2021-09-28 02:02:44 +08:00
"""
Return a string representing a character whose Unicode
code point is an integer
"""
p = cobj(1)
p[0] = byte(i)
return str(p, 1)
2022-01-24 14:47:43 +08:00
def next(g: Generator[T], default: Optional[T] = None, T: type) -> T:
2021-09-28 02:02:44 +08:00
"""
Return the next item from g
"""
if g.done():
if default is not None:
return default.__val__()
2021-09-28 02:02:44 +08:00
else:
raise StopIteration()
return g.next()
2022-01-24 14:47:43 +08:00
def any(x: Generator[T], T: type) -> bool:
2021-09-28 02:02:44 +08:00
"""
Returns True if any item in x is true,
False otherwise
"""
for a in x:
if a:
return True
return False
2022-01-24 14:47:43 +08:00
def all(x: Generator[T], T: type) -> bool:
2021-09-28 02:02:44 +08:00
"""
Returns True when all elements in x are true,
False otherwise
"""
for a in x:
if not a:
return False
return True
def zip(*args):
"""
Returns a zip object, which is an iterator of tuples
that aggregates elements based on the iterables passed
"""
if staticlen(args) == 0:
yield from List[int]()
else:
iters = tuple(iter(i) for i in args)
done = False
while not done:
for i in iters:
if i.done():
done = True
if not done:
yield tuple(i.next() for i in iters)
for i in iters:
i.destroy()
2022-01-24 14:47:43 +08:00
def filter(f: Callable[[T], bool], x: Generator[T], T: type) -> Generator[T]:
2021-09-28 02:02:44 +08:00
"""
Returns all a from the iterable x that are filtered by f
"""
for a in x:
if f(a):
yield a
def map(f, *args):
"""
Applies a function on all a in x and returns map object
"""
if staticlen(args) == 0:
compile_error("map() expects at least one iterator")
elif staticlen(args) == 1:
for a in args[0]:
yield f(a)
else:
for a in zip(*args):
yield f(*a)
def enumerate(x, start: int = 0):
"""
Creates a tuple containing a count (from start which defaults
to 0) and the values obtained from iterating over x
"""
i = start
for a in x:
2022-01-24 14:47:43 +08:00
yield (i, a)
2021-09-28 02:02:44 +08:00
i += 1
def echo(x):
"""
Print and return argument
"""
print x
return x
def reversed(x):
"""
Return an iterator that accesses x in the reverse order
"""
if hasattr(x, "__reversed__"):
return x.__reversed__()
else:
i = x.__len__() - 1
while i >= 0:
yield x[i]
i -= 1
2021-09-28 02:02:44 +08:00
2022-01-24 14:47:43 +08:00
def round(x, n=0):
2021-09-28 02:02:44 +08:00
"""
Return the x rounded off to the given
n digits after the decimal point.
"""
nx = float.__pow__(10.0, n)
return float.__round__(x * nx) / nx
def sum(xi):
"""
Return the sum of the items added together from xi
"""
x = iter(xi)
if not x.done():
s = x.next()
while not x.done():
s += x.next()
x.destroy()
return s
else:
x.destroy()
def repr(x):
2022-01-24 14:47:43 +08:00
"""Return the string representation of x"""
2021-09-28 02:02:44 +08:00
return x.__repr__()
2022-01-24 14:47:43 +08:00
def _int_format(a: int, base: int, prefix: str = ""):
assert base == 2 or base == 8 or base == 10 or base == 16
2022-01-24 14:47:43 +08:00
chars = "0123456789abcdef-"
b = a
digits = 0
while b != 0:
digits += 1
b //= base
sz = digits + (1 if a <= 0 else 0) + len(prefix)
p = Ptr[byte](sz)
q = p
if a < 0:
q[0] = chars[-1].ptr[0]
q += 1
if prefix:
str.memcpy(q, prefix.ptr, len(prefix))
q += len(prefix)
if digits != 0:
b = a
q += digits - 1
i = 1
while b != 0:
i += 1
q[0] = chars.ptr[abs(b % base)]
q += -1
b //= base
else:
q[0] = chars.ptr[0]
return str(p, sz)
def bin(n):
2022-01-24 14:47:43 +08:00
return _int_format(n.__index__(), 2, "0b")
def oct(n):
2022-01-24 14:47:43 +08:00
return _int_format(n.__index__(), 8, "0o")
def hex(n):
2022-01-24 14:47:43 +08:00
return _int_format(n.__index__(), 16, "0x")
2021-09-28 02:02:44 +08:00
@extend
class int:
def _from_str(s: str, base: int):
from C import strtoll(cobj, Ptr[cobj], i32) -> int
2022-01-24 14:47:43 +08:00
2021-09-28 02:02:44 +08:00
if base < 0 or base > 36 or base == 1:
raise ValueError("int() base must be >= 2 and <= 36, or 0")
buf = __array__[byte](32)
n = len(s)
2022-01-24 14:47:43 +08:00
need_dyn_alloc = n >= len(buf)
2021-09-28 02:02:44 +08:00
p = alloc_atomic(n + 1) if need_dyn_alloc else buf.ptr
str.memcpy(p, s.ptr, n)
p[n] = byte(0)
end = cobj()
result = strtoll(p, __ptr__(end), i32(base))
if need_dyn_alloc:
free(p)
if end != p + n:
2022-01-24 14:47:43 +08:00
raise ValueError(
2022-02-16 23:51:16 +08:00
f"invalid literal for int() with base {base}: {s}"
2022-01-24 14:47:43 +08:00
)
2021-09-28 02:02:44 +08:00
return result
2021-11-22 21:32:49 +08:00
2022-01-19 13:19:52 +08:00
def _jit_display(x, s: Static[str], bundle: Set[str] = Set[str]()):
Typechecker refactoring (#20) * Initial refactor commit * Support external vars * Simplify refactor; Python scoping [wip] * Python scoping [wip] * Python scoping [fix loops; wip] * Fix lambdas * Python scoping [test fixes; wip] * Fix scoping [wip] * Fix basic tests [no-ci] * Fix tests * CallExpr refactoring [wip] * CallExpr refactoring [wip] * Remove activeUnbounds tracking * Add core.codon * Move Function and other core types to core.codon; Revamp Function and Callable types * Refactor IntExpr, FloatExpr and CallExpr * Refactor ClassStmt * Refactor context, IdExpr and DotExpr * Refactor DotExpr and AssignStmt * Refactor ImportStmt * Refactor FunctionStmt * Refactor * Remove UpdateStmt * Refactor AssignReplacementVisitor * Make SimplifyVisitor in-place * Fix new scoping * Fix import type alias handling * Add docstrings; Complete Simplify refactoring * Fixes for seqtest * Refactor typecheck [wip] * Refactor typecheck [wip] * Refactor typecheck/access; Remove void anduse NoneType; Fix #18 * Refactor typecheck/assign * clang-format and cmake-format * Fix none types in IR * Multi-error support in simplify * Fix IR tests for new void * Simplify ClassStmt * Refactor cond.cpp * Refactor error.cpp * Refactor function.cpp and simplify unbounds * Refactor op.cpp * Refactor call.cpp [wip] [no-ci] * seqassertn updates [noci] * Refactor call.cpp * Refactor call.cpp * Refactor call.cpp * Refactor typecheck * clang-tidy updates [noci] * Refactor infer.cpp [wip] * Refactor infer.cpp * Refactor wrapExpr * Remove visitedAsts * Remove old base logic * Refactor typecheck ctx * Fix JIT bug * Fix JIT tests * Scoping fixes [wip] [noci] * Fix ImperativeForFlow var store * Add newlines [noci] * Dump IR module with log flag * Fix scoping bugs; Add &, ^ and | static operations; Address stylistic review issues * Fix side effect analysis for for-loops * Add support for class variables and ClassVar * Refactor special dot-member cases * Add codon app tests * Fix class variables; clang-tidy * Fix __argv__ * Add datetime constants and update tests * Fix #25; Add Py_None, Py_True and Py_False; External var support [wip] * External var support [wip] * Dump LLVM IR when debug flags are active * clang-format * Fix arg var construction * Extern var fixes * Undo extern var changes related to stdout etc. * Fix tuple magics * Fix extern vars and tuple magics * Fix duplicate var name error * Fix extern vars * Fix #16 * Fix side-effect analysis for try-catch * Move test C var to test executable * Add staticmethod * Fix var status for try-catch * Fix tests * Fix shell var name * Fix test * Fix app test * Fix scoping issue (remove dominated identifier from stack) * Fix no-pie issue * Use PIC when building library object * Don't use -no-pie when building library [noci] * Use -relocation-model=pic in test * Fix lib build on Linux * Fix lib build * Update exceptions to use subclasses vs. header * Fix __repr__ * Fix tests * Fix exceptions test * Don't build docs Co-authored-by: A. R. Shajii <ars@ars.me>
2022-07-27 04:06:00 +08:00
if isinstance(x, None):
return
2022-01-05 02:13:59 +08:00
if hasattr(x, "_repr_mimebundle_") and s == "jupyter":
d = x._repr_mimebundle_(bundle)
# TODO: pick appropriate mime
mime = next(d.keys()) # just pick first
print(f"\x00\x00__codon/mime__\x00{mime}\x00{d[mime]}", end='')
2021-11-22 21:32:49 +08:00
elif hasattr(x, "__repr__"):
2022-01-05 02:13:59 +08:00
print(x.__repr__(), end='')
2021-11-22 21:32:49 +08:00
elif hasattr(x, "__str__"):
2022-01-05 02:13:59 +08:00
print(x.__str__(), end='')