Updates to docs and scripts

Readme.md

@@ -8,6 +8,10 @@ These build up a code AST to then serialize with a file builder, or can be trave
 This code base attempts follow the [handmade philosophy](https://handmade.network/manifesto).
 Its not meant to be a black box metaprogramming utility, it should be easy to intergrate into a user's project domain.
 
+# Documentation
+
+[]
+
 ## Notes
 
 **On Partial Hiatus: Life has got me tackling other issues..**
@@ -21,10 +25,6 @@ The library can already be used to generate code just fine, but the parser is wh
 
 A `natvis` and `natstepfilter` are provided in the scripts directory (its outdated, I'll update this readme when its not).
 
-***The editor and scanner have not been implemented yet. The scanner will come first, then the editor.***
-
-A C variant is hosted [here](https://github.com/Ed94/genc); I will complete it when this library is feature complete, it should be easier to make than this...
-
 ## Usage
 
 A metaprogram is built to generate files before the main program is built. We'll term runtime for this program as `GEN_TIME`. The metaprogram's core implementation are within `gen.hpp` and `gen.cpp` in the project directory.

base/Readme.md

@@ -25,19 +25,6 @@ Standard formats:
 
 Code not making up the core library is located in `auxiliary/<auxiliary_name>.<hpp/cpp>`. These are optional extensions or tools for the library.
 
-Feature Macros:
-
-* `GEN_DEFINE_ATTRIBUTE_TOKENS` : Allows user to define their own attribute macros for use in parsing.
-  * This is auto-generated if using the bootstrap or single-header generation
-  * *Note: The user will use the `AttributeTokens.csv` when the library is fully self-hosting.*
-* `GEN_DEFINE_LIBRARY_CORE_CONSTANTS` : Optional typename codes as they are non-standard to C/C++ and not necessary to library usage
-* `GEN_DONT_ENFORCE_GEN_TIME_GUARD` : By default, the library ( gen.hpp/ gen.cpp ) expects the macro `GEN_TIME` to be defined, this disables that.
-* `GEN_ENFORCE_STRONG_CODE_TYPES` : Enforces casts to filtered code types.
-* `GEN_EXPOSE_BACKEND` : Will expose symbols meant for internal use only.
-* `GEN_ROLL_OWN_DEPENDENCIES` : Optional override so that user may define the dependencies themselves.
-* `GEN_DONT_ALLOW_INVALID_CODE` (Not implemented yet) : Will fail when an invalid code is constructed, parsed, or serialized.
-* `GEN_C_LIKE_PP` : Will prevent usage of function defnitions using references and structs with member functions.
-Structs will still have user-defined operator conversions, for-range support, and other operator overloads
 
 *Note: A variant of the C++ library could be generated where those additonal support features are removed (see gen_c_library implementation for an idea of how)*
 

docs/Readme.md

@@ -27,7 +27,7 @@ This library was written in a subset of C++ where the following are not used at
 Polymorphic & Member-functions are used as an ergonomic choice, along with a conserative use of operator overloads.
 The base library itself does not use anything but C-like features to allow for generating a derviative compatiable with C (WIP).
 
-There are only 4 template definitions in the entire library. (`Array<Type>`, `Hashtable<Type>`, `swap<Type>`, and `AST/Code::cast<Type>`)
+There are only 4 template definitions in the entire library (C++ versions). (`Array<Type>`, `Hashtable<Type>`, `swap<Type>`, and `AST/Code::cast<Type>`)
 
 Two generic templated containers are used throughout the library:
 
@@ -43,8 +43,7 @@ Otherwise the library is free of any templates.
 ### *WHAT IS NOT PROVIDED*
 
 **There is no support for validating expressions.**  
-Its difficult to parse without enough benefits (At the metaprogramming level).  
+Its a [todo](https://github.com/Ed94/gencpp/issues/49)
-I plan to add this only at the tail of the project parsing milestone.
 
 **Only trivial template support is provided.**
 The intention is for only simple, non-recursive substitution.
@@ -55,10 +54,22 @@ This means that the typename entry for the parameter AST would be either:
 * `typename`
 * A fundamental type, function, or pointer type.
 
-Anything beyond this usage is not supported by parse_template for arguments (at least not intentionally).  
+***Concepts and Constraints are not supported***  
-Use at your own mental peril.
+Its a [todo](https://github.com/Ed94/gencpp/issues/21)
 
-*Concepts and Constraints are not supported, its usage is non-trivial substitution.*
+### Feature Macros:
+
+* `GEN_DEFINE_ATTRIBUTE_TOKENS` : Allows user to define their own attribute macros for use in parsing.
+  * This is auto-generated if using the bootstrap or single-header generation
+  * *Note: The user will use the `AttributeTokens.csv` when the library is fully self-hosting.*
+* `GEN_DEFINE_LIBRARY_CORE_CONSTANTS` : Optional typename codes as they are non-standard to C/C++ and not necessary to library usage
+* `GEN_DONT_ENFORCE_GEN_TIME_GUARD` : By default, the library ( gen.hpp/ gen.cpp ) expects the macro `GEN_TIME` to be defined, this disables that.
+* `GEN_ENFORCE_STRONG_CODE_TYPES` : Enforces casts to filtered code types.
+* `GEN_EXPOSE_BACKEND` : Will expose symbols meant for internal use only.
+* `GEN_ROLL_OWN_DEPENDENCIES` : Optional override so that user may define the dependencies themselves.
+* `GEN_DONT_ALLOW_INVALID_CODE` (Not implemented yet) : Will fail when an invalid code is constructed, parsed, or serialized.
+* `GEN_C_LIKE_PP` : Will prevent usage of function defnitions using references and structs with member functions.
+Structs will still have user-defined operator conversions, for-range support, and other operator overloads
 
 ### The Data & Interface
 
@@ -67,66 +78,7 @@ As mentioned in root readme, the user is provided Code objects by calling the co
 The AST is managed by the library and provided to the user via its interface.
 However, the user may specifiy memory configuration.
 
-Data layout of AST struct (Subject to heavily change with upcoming redesign):
+[Data layout of AST struct (Subject to heavily change with upcoming todos)](C:\projects\gencpp\base\components\ast.hpp#L396-462)
-
-```cpp
-union {
-    struct
-    {
-        AST*      InlineCmt;       // Class, Constructor, Destructor, Enum, Friend, Functon, Operator, OpCast, Struct, Typedef, Using, Variable
-        AST*      Attributes;      // Class, Enum, Function, Struct, Typedef, Union, Using, Variable
-        AST*      Specs;           // Destructor, Function, Operator, Typename, Variable
-        union {
-            AST*  InitializerList; // Constructor
-            AST*  ParentType;      // Class, Struct, ParentType->Next has a possible list of interfaces.
-            AST*  ReturnType;      // Function, Operator, Typename
-            AST*  UnderlyingType;  // Enum, Typedef
-            AST*  ValueType;       // Parameter, Variable
-        };
-        union {
-            AST*  Macro;           // Parameters
-            AST*  BitfieldSize;    // Variable (Class/Struct Data Member)
-            AST*  Params;          // Constructor, Function, Operator, Template, Typename
-        };
-        union {
-            AST*  ArrExpr;          // Typename
-            AST*  Body;             // Class, Constructr, Destructor, Enum, Function, Namespace, Struct, Union
-            AST*  Declaration;      // Friend, Template
-            AST*  Value;            // Parameter, Variable
-        };
-        union {
-            AST*  NextVar;          // Variable; Possible way to handle comma separated variables declarations. ( , NextVar->Specs NextVar->Name NextVar->ArrExpr = NextVar->Value )
-            AST*  SpecsFuncSuffix;  // Only used with typenames, to store the function suffix if typename is function signature.
-        };
-    };
-    StringCached  Content;          // Attributes, Comment, Execution, Include
-    struct {
-        SpecifierT ArrSpecs[AST_ArrSpecs_Cap]; // Specifiers
-        AST*       NextSpecs;                   // Specifiers
-    };
-};
-union {
-    AST* Prev;
-    AST* Front;
-    AST* Last;
-};
-union {
-    AST* Next;
-    AST* Back;
-};
-AST*              Parent;
-StringCached      Name;
-CodeT             Type;
-ModuleFlag        ModuleFlags;
-union {
-    b32           IsFunction;  // Used by typedef to not serialize the name field.
-    b32           IsParamPack; // Used by typename to know if type should be considered a parameter pack.
-    OperatorT     Op;
-    AccessSpec    ParentAccess;
-    s32           NumEntries;
-};
-s32               Token;       // Handle to the token, stored in the CodeFile (Otherwise unretrivable)
-```
 
 *`CodeT` is a typedef for `ECode::Type` which has an underlying type of `u32`*
 *`OperatorT` is a typedef for `EOperator::Type` which has an underlying type of `u32`*
@@ -474,11 +426,8 @@ and have the desired specifiers assigned to them beforehand.
 There are three provided auxillary interfaces:
 
 * Builder
-* Editor
 * Scanner
 
-Editor and Scanner are disabled by default, use `GEN_FEATURE_EDITOR` and `GEN_FEATURE_SCANNER` to enable them.
-
 ### Builder is a similar object to the jai language's string_builder
 
 * The purpose of it is to generate a file.

scripts/build.ci.ps1

@@ -3,36 +3,15 @@
 # That or just rewrite it in an sh script and call it a day.
 
 $devshell           = Join-Path $PSScriptRoot 'helpers/devshell.ps1'
-$format_cpp	        = Join-Path $PSScriptRoot 'helpers/format_cpp.psm1'
+$misc               = Join-Path $PSScriptRoot 'helpers/misc.psm1'
 $refactor_c_library = Join-Path $PSScriptRoot 'refactor_c_library.ps1'
 $refactor_unreal    = Join-Path $PSScriptRoot 'refactor_unreal.ps1'
 $incremental_checks = Join-Path $PSScriptRoot 'helpers/incremental_checks.ps1'
 $vendor_toolchain   = Join-Path $PSScriptRoot 'helpers/vendor_toolchain.ps1'
 
-function Get-ScriptRepoRoot {
+Import-Module $misc
-    $currentPath = $PSScriptRoot
-    while ($currentPath -ne $null -and $currentPath -ne "")
-	{
-        if (Test-Path (Join-Path $currentPath ".git")) {
-            return $currentPath
-        }
-        # Also check for .git file which indicates a submodule
-        $gitFile = Join-Path $currentPath ".git"
-        if (Test-Path $gitFile -PathType Leaf)
-		{
-            $gitContent = Get-Content $gitFile
-            if ($gitContent -match "gitdir: (.+)") {
-                return $currentPath
-            }
-        }
-        $currentPath = Split-Path $currentPath -Parent
-    }
-    throw "Unable to find repository root"
-}
-$path_root = Get-ScriptRepoRoot
 
-# Import-Module $target_arch
+$path_root = Get-ScriptRepoRoot
-Import-Module $format_cpp
 
 Push-Location $path_root
 

scripts/clean.ps1

@@ -1,62 +1,42 @@
 $path_root               = git rev-parse --show-toplevel
-$path_project            = Join-Path $path_root project
+$path_base               = Join-Path $path_root         base
-$path_project_build      = Join-Path $path_project build
+$path_base_build         = Join-Path $path_base         build
-$path_project_gen		 = Join-Path $path_project gen
+$path_singleheader       = Join-Path $path_root         singleheader
-$path_singleheader       = Join-Path $path_root singleheader
 $path_singleheader_build = Join-Path $path_singleheader build
 $path_singleheader_gen	 = Join-Path $path_singleheader gen
-$path_test               = Join-Path $path_root test
+$path_unreal             = Join-Path $paht_root         unreal
-$path_test_build         = Join-Path $path_test build
+$path_unreal_build       = Join-Path $path_unreal       build
-$path_test_gen           = Join-Path $path_test gen
+$path_unreal_gen         = Join-Path $path_unreal       gen
-$path_x64				 = Join-Path $path_root x64
+$path_test               = Join-Path $path_root         test
-$path_release			 = Join-Path $path_root release
+$path_test_build         = Join-Path $path_test         build
+$path_test_gen           = Join-Path $path_test         gen
+$path_x64				 = Join-Path $path_root         x64
+$path_release			 = Join-Path $path_root         release
 
-if ( Test-Path $path_project_build)
+if ( Test-Path $path_project_build) {
-{
 	Remove-Item $path_project_build -Recurse
 }
-
+if ( Test-Path $path_project_gen ) {
-if ( Test-Path $path_project_gen )
-{
 	Remove-Item $path_project_gen -Recurse
 }
-
+if ( Test-Path $path_singleheader_build) {
-if ( Test-Path $path_singleheader_build)
-{
 	Remove-Item $path_singleheader_build -Recurse
 }
-
+if ( Test-Path $path_singleheader_gen ) {
-if ( Test-Path $path_singleheader_gen )
-{
 	Remove-Item $path_singleheader_gen -Recurse
 }
-
+if ( Test-Path $path_unreal ) {
-if ( Test-Path $path_test_build )
+	Remove-Item $path_unreal_build -Recurse
-{
+}
+if ( Test-Path $path_test_build ) {
 	Remove-Item $path_test_build -Recurse
 }
-
+if ( Test-Path $path_test_gen ) {
-if ( Test-Path $path_test_gen )
-{
 	Remove-Item $path_test_gen -Recurse
 }
-
+if ( Test-Path $path_x64) {
-if ( Test-Path $path_x64)
-{
 	Remove-Item $path_x64 -Recurse
 }
-
+if ( Test-Path $path_release ) {
-if ( Test-Path $path_release )
-{
 	Remove-Item $path_release -Recurse
 }
-
-$include = '*.h', '*.hpp', '*.cpp'
-$exclude =
-
-$files = Get-ChildItem -Recurse -Path $path_gen -Include $include -Exclude $exclude
-
-if ( $files )
-{
-	Remove-Item $files
-}

scripts/helpers/misc.psm1

@@ -0,0 +1,20 @@
+function Get-ScriptRepoRoot {
+    $currentPath = $PSScriptRoot
+    while ($currentPath -ne $null -and $currentPath -ne "")
+	{
+        if (Test-Path (Join-Path $currentPath ".git")) {
+            return $currentPath
+        }
+        # Also check for .git file which indicates a submodule
+        $gitFile = Join-Path $currentPath ".git"
+        if (Test-Path $gitFile -PathType Leaf)
+		{
+            $gitContent = Get-Content $gitFile
+            if ($gitContent -match "gitdir: (.+)") {
+                return $currentPath
+            }
+        }
+        $currentPath = Split-Path $currentPath -Parent
+    }
+    throw "Unable to find repository root"
+}