Machine Learning Compilers¶
GETTING STARTED
SUBMISSIONS
- Submission 2025-04-17
- Hello Assembly
- Assembly Function
- 1. Assemble the file and use the name
add_values.ofor the output. - 2. Generate the following from
add_values.o: - 3. Find the size of the
.textsection in the generated output and explain it. - 4. Write a C++ driver that calls the
add_valuesfunction and illustrate it with an example. - 5. Use the GNU Project Debugger GDB to step through an example call to the
add_valuesfunction. Display the contents of the general-purpose registers after each of the executed instructions.
- 1. Assemble the file and use the name
- Submission 2025-04-24
- Submission 2025-05-01
- Execution Throughput and Latency
- Microkernel
- Loops
- 1. Loop over K: Implement a kernel that computes C+=AB for M=16, N=6 and K=64.
- 2. Loop over M: Implement a kernel that computes C+=AB for M=64, N=6 and K=64.
- 3. Loop over N: Implement a kernel that computes C+=AB for M=64, N=48 and K=64.
- 1. Test and optimize the kernels. Report your performance in GFLOPS.
- Submission 2025-05-08
- Submission 2025-05-15
- Neon Batch-Reduce GEMM
- GEMM
- 1. Extend generate to support M-N-K combinations for column-major format \(1 \leq M,N \leq 1024, 1 \leq K \leq 2028\)
- 2. Verify all matrices for
1≤M≤64,1≤N≤64,K∈[1,16,32,64,128],``lda=M``,ldb=K, andldc=M - 3. Verify all matrices for
1≤M≤64,1≤N≤64,K∈[1,16,32,64,128],``lda>M``,ldb>K, andldc>M - 4. Benchmark for
1≤M≤64,1≤N≤64,K∈[1,16,32,64,128],``lda=M``,ldb=K, andldc=M.
- Batch-Reduce GEMM
- Submission 2025-05-22
- Transposition
- Unary Primitives
- Zero Primitive
- 1. mini_jit::Unary::generate function to support the zero primitive
- 2. Test and optimize
- Identity Primitive
- 1. mini_jit::Unary::generate function to support the identity primitive
- 2. Test and optimize
- ReLu Primitive
- 1. mini_jit::Unary::generate function to support the ReLu primitive
- 2. Test and optimize
- Submission 2025-05-29
- Submission 2025-06-05
- Submission 2025-06-12
- Submission 2025-06-19
- Individual Phase
API
- mini_jit
mini_jit::Brgemmmini_jit::EinsumTreeErrorParseErrorExecuteNoneInvalidRootNotEnoughInputTensorsTooManyInputTensorsNullPtrAsInputTensorerr_wrong_dtypeerr_wrong_dimensionerr_wrong_primitiveerr_wrong_first_touch_primitiveerr_wrong_main_primitiveerr_wrong_last_touch_primitiveerr_execution_type_not_supportederr_invalid_primitive_configurationerr_invalid_first_touch_configurationerr_invalid_main_configurationerr_invalid_last_touch_configurationerr_invalid_execution_ordererr_invalid_strideserr_k_dimension_must_not_be_sharederr_shared_required_for_parallel_execution
NodeTypeEinsumTree()EinsumTree()~EinsumTree()set_sorted_dim_sizes()parse_tree_no_optimization()parse_tree()get_root()optimize()conditional_swap()reorder_left_node()reorder_right_node()execute()parse_node()lower_node()get_config_dim_types_and_sizes()get_config_strides()execute_node()assign_tensor_indices()is_unit_stride_n()parse_dim_list()compute_strides()get_output_dims()parse_setup_error()delete_tree()findKDim()findNDim()findMDim()tensorIndexroottree_strerror_parsedim_sizesmini_jit::EinsumTree::EinsumNode
mini_jit::Kernelmini_jit::TensorConfigmini_jit::TensorOperationerror_tsuccesserr_wrong_dtypeerr_wrong_dimensionerr_wrong_primitiveerr_wrong_first_touch_primitiveerr_wrong_main_primitiveerr_wrong_last_touch_primitiveerr_execution_type_not_supportederr_invalid_primitive_configurationerr_invalid_first_touch_configurationerr_invalid_main_configurationerr_invalid_last_touch_configurationerr_invalid_execution_ordererr_invalid_strideserr_k_dimension_must_not_be_sharederr_shared_required_for_parallel_execution
stride_tsetup()setup_no_optimization()execute()execute_dimension()get_config()write_kernel_to_file()isExpectedStride()isValidStride()isUnary()isBrgemm()findMatch()isValidPrimConfig()isValidPrimStrides()isValidKDim()isSortedConfiguration()generateUnary()configdtypeprim_firstprim_mainprim_lastdim_typesexec_typesdim_sizesstrides_in0strides_in1strides_outindexPrimMindexPrimNindexPrimKindexPrimBatchfirst_touchmain_kernellast_touchisParallelisTransposehasSetupError
mini_jit::TensorOptimizationoptimize()optimize_primitive_identification()optimize_shared_identification()optimize_dimension_reordering_shared()optimize_dimension_reordering_fusing()optimize_dimension_splitting()optimize_dimension_fusing()_reorder_helper_adjust_index()_primitive_identification()_shared_identification()_dimension_reordering_shared()_dimension_reordering_fusing()_swap_elements()_move_elements()_dimension_splitting()_dimension_fusing()thread_countmaximum_inbalanced_parallel_precentagefuse_split_dimension_size
mini_jit::Unary- arm_instructions
R32BitR64BitShiftLSLShiftLSRShiftASRShiftRORV8BitV16BitV32BitV64BitV128BitVGeneralVType8x8BitVType16x8BitVType4x16BitVType8x16BitVType2x32BitVType4x32BitVType1x64BitVType2x64Bitmask1mask2mask3mask4mask5mask6mask7mask8mask9mask10mask11mask12mask13mask14mask15mask16mask17mask18mask19w0w1w2w3w4w5w6w7w8w9w10w11w12w13w14w15w16w17w19w20w21w22w23w24w25w26w27w28w29w30wspwzrx0x1x2x3x4x5x6x7x8x9x10x11x12x13x14x15x16x17x19x20x21x22x23x24x25x26x27x28x29x30fplrspxzrLSLLSRASRRORb0b1b2b3b4b5b6b7b8b9b10b11b12b13b14b15b16b17b18b19b20b21b22b23b24b25b26b27b28b29b30b31h0h1h2h3h4h5h6h7h8h9h10h11h12h13h14h15h16h17h18h19h20h21h22h23h24h25h26h27h28h29h30h31s0s1s2s3s4s5s6s7s8s9s10s11s12s13s14s15s16s17s18s19s20s21s22s23s24s25s26s27s28s29s30s31d0d1d2d3d4d5d6d7d8d9d10d11d12d13d14d15d16d17d18d19d20d21d22d23d24d25d26d27d28d29d30d31q0q1q2q3q4q5q6q7q8q9q10q11q12q13q14q15q16q17q18q19q20q21q22q23q24q25q26q27q28q29q30q31v0v1v2v3v4v5v6v7v8v9v10v11v12v13v14v15v16v17v18v19v20v21v22v23v24v25v26v27v28v29v30v31t8bt16bt4ht8ht2st4st1dt2dadd()add()add()add()add()add()add()add()cbnz()cbnz()ldpPost()ldpPost()ldpPre()ldpPre()ldp()ldp()ldpOffset()ldpOffset()ldrPost()ldrPost()ldrPre()ldrPre()ldr()ldr()ldrOffset()ldrOffset()lsl()lsl()madd()madd()mov()mov()mov()mov()mov()mov()movSp()movSp()movn()movn()movn()movn()movz()movz()movz()movz()orr()orr()orr()orr()ret()ret()stpPost()stpPost()stpPre()stpPre()stp()stp()stpOffset()stpOffset()sub()sub()sub()sub()eor()eor()fmax()fmax()fmax()fmax()fmax()fmax()fmla()fmla()fmla()fmla()fmla< VType4x16Bit >()fmla< VType8x16Bit >()ld1()ld1()ld1()ld1()ld1Post()ld1Post()ld1Post()ld1Post()ld1Post()ld1Post()ld1Post()ld1Post()ld1()ld1()ld1()ld1()ld1Post()ld1Post()ld1Post()ld1Post()ld1Post()ld1Post()ld1Post()ld1Post()ldpPost()ldpPost()ldpPost()ldpPre()ldpPre()ldpPre()ldp()ldp()ldp()ldpOffset()ldpOffset()ldpOffset()ldrPost()ldrPost()ldrPost()ldrPost()ldrPost()ldrPre()ldrPre()ldrPre()ldrPre()ldrPre()ldr()ldr()ldr()ldr()ldr()ldrOffset()ldrOffset()ldrOffset()ldrOffset()ldrOffset()st1()st1()st1()st1()st1Post()st1Post()st1Post()st1Post()st1Post()st1Post()st1Post()st1Post()st1()st1()st1()st1()st1Post()st1Post()st1Post()st1Post()st1Post()st1Post()st1Post()st1Post()stpPost()stpPost()stpPost()stpPre()stpPre()stpPre()stp()stp()stp()stpOffset()stpOffset()stpOffset()strPost()strPost()strPost()strPost()strPost()strPre()strPre()strPre()strPre()strPre()str()str()str()str()str()strOffset()strOffset()strOffset()strOffset()strOffset()trn1()trn1()trn1()trn1()trn1()trn1()trn1()trn2()trn2()trn2()trn2()trn2()trn2()trn2()zip1()zip1()zip1()zip1()zip1()zip1()zip1()zip2()zip2()zip2()zip2()zip2()zip2()zip2()- internal
addShiftTypeorrShiftTypesubShiftTypeeorSimdTypesfmaxSzTypefmaxQTypefmaxFTypefmlaHalfPrecisionTypesfmlaSingleDoublePrecisionTypesld1DataTypesld1TypesldpSimdFpDataTypesldrSimdFpDataTypesst1DataTypesst1TypesstpSimdFpDataTypesstrSimdFpDataTypestrn1SizeTypetrn1QTypetrn2SizeTypetrn2QTypezip1SizeTypezip1QTypezip2SizeTypezip2QTypeld1ImmediateRmst1ImmediateRm_addParseShiftType()_addParseShiftType< ShiftLSL >()_addParseShiftType< ShiftLSR >()_addParseShiftType< ShiftASR >()addShiftedRegister()addImmediate()cbnz()_ldpPostPreOffset()ldpPost()ldpPre()ldpOffset()ldrImmediatePost()ldrImmediatePre()ldrImmediateOffset()lslImmediate()madd()movn()movz()_orrParseShiftType()_orrParseShiftType< ShiftLSL >()_orrParseShiftType< ShiftLSR >()_orrParseShiftType< ShiftASR >()_orrParseShiftType< ShiftROR >()orrShiftedRegister()ret()_stpPostPreOffset()stpPost()stpPre()stpOffset()subImmediate()eorVector()fmaxVector()fmaxScalar()_fmlaIsDouble()_fmlaIsDouble< VType2x32Bit >()_fmlaIsDouble< VType4x32Bit >()_fmlaIsDouble< VType2x64Bit >()_fmlaParseSingleDoubleType()_fmlaParseSingleDoubleType< VType2x32Bit >()_fmlaParseSingleDoubleType< VType4x32Bit >()_fmlaParseSingleDoubleType< VType2x64Bit >()fmlaByElementScalarHalfPrecision()fmlaByElementScalarSingleDoublePrecision()fmlaByElementVectorHalfPrecision()fmlaByElementVectorSingleDoublePrecision()_ld1ParseType()_ld1ParseType< VType8x8Bit >()_ld1ParseType< VType16x8Bit >()_ld1ParseType< VType4x16Bit >()_ld1ParseType< VType8x16Bit >()_ld1ParseType< VType2x32Bit >()_ld1ParseType< VType4x32Bit >()_ld1ParseType< VType1x64Bit >()_ld1ParseType< VType2x64Bit >()_ld1GetQAndSize()_ld1GetOpCode()ld1MultipleStructures()ld1MultipleStructuresPost()ld1SingleStructures()ld1SingleStructuresPost()_ldpSimdFpPostPreOffset()ldpPost()ldpPre()ldpOffset()_ldrSimdFpGetOpCode()ldrSimdFpImmediatePost()ldrSimdFpImmediatePre()ldrSimdFpImmediateOffset()_st1ParseType()_st1ParseType< VType8x8Bit >()_st1ParseType< VType16x8Bit >()_st1ParseType< VType4x16Bit >()_st1ParseType< VType8x16Bit >()_st1ParseType< VType2x32Bit >()_st1ParseType< VType4x32Bit >()_st1ParseType< VType1x64Bit >()_st1ParseType< VType2x64Bit >()_st1GetQAndSize()_st1GetOpCode()st1MultipleStructures()st1MultipleStructuresPost()st1SingleStructures()st1SingleStructuresPost()_stpSimdFpPostPreOffset()stpPost()stpPre()stpOffset()_strSimdFpGetOpCode()strSimdFpImmediatePost()strSimdFpImmediatePre()strSimdFpImmediateOffset()_trn1()_trn2()_zip1()_zip2()
- kernels
br_matmul_16m_4n_k()br_matmul_16m_lt4nRest_k()br_matmul_16mRest_4n_k()br_matmul_16mRest_lt4nRest_k()br_matmul_lt16_4n_k()br_matmul_lt16_lt4nRest_k()matmul_16_6_1()matmul_16_6_k()matmul_16m_4n_k()matmul_16m_lt4nRest_k()matmul_16mRest_4n_k()matmul_16mRest_lt4nRest_k()matmul_lt16_4n_k()matmul_lt16_lt4nRest_k()unary_identity()unary_identity_transpose()unary_relu()unary_relu_transpose()unary_zero()unary_zero_16m_n()