MaxCompute Studio

Compatible with: IntelliJ IDEA PhpStorm WebStorm PyCharm RubyMine AppCode CLion GoLand DataGrip Rider
Oct 24, 2018
311 198

MaxCompute is a big data processing platform developed by Alibaba Cloud independently. It is a fast and cloud-based big data solution that supports multiple distributed data storage and processing models, which can provide massive data warehouse and big data modeling service.

MaxCompute Studio is a plugin for IntelliJ platform allowing data developers works with MaxCompute platform including authoring SQL scripts, UDF extensions, MapReduce programs and other functions like local debugging, data browsing and uploading/downloading, job browsing and analytics, etc.

Features include:

  • MaxCompute SQL language support
  • MaxCompute function development
  • MaxCompute data management
  • MaxCompute job management

Download plugin

Recent change notes

Changes in Version 3.0.1:

  • New Feature:
    • support batch set MaxCompute project for script folder.
    • support grant sql generate wizard.
  • Enhancement:
    • log exception stack trace when compile error.
    • remember user input on udf deploy.
  • Bug Fix:
    • edge schema display bug in operation graph.
    • can't display char type schema bug.
    • can't display pot graph when there is buffered operation.
    • compile error in studio when multi partitions.
    • string in java file compile error.
    • date format inspect error.
    • create function NPE when none MaxCompute project.
    • MR main class check logic.

Changes in Version

  • Bug Fix:
    • Instance analysis page bug fix
    • Instance analysis adapt to dark schema
    • Fix NPE on opening some special instance detail page

Changes in Version 3.0.0:

  • New Feature:
    • support write authorization statement, show user privileges and diagnosis auth exception message.
    • use web view to draw sql pot graph and performance enhancement.
    • support copy project meta.
    • support show project detail.
    • support variable in sql editor.
    • support input/output byte hot graph and display edge schema in operation level graph.
    • Show optimizer relation plan in analysis page for sql instance.
    • Show formatted pot/midlot in analysis page and support text search.
  • Enhancement:
    • multi keyword code completion enhancement.
    • set and setproject code completion.
    • with menu item icon in project explorer.
    • editor support merge small files statements.
    • give user choice to format json when view cell detail.
    • sql select result searchable.
    • convert 'create table as' to 'insert overwrite table' intention action.
    • support specify your own python path to resolve python UDF.
    • use typeinfo to display edge schema instead of type which is more accuracy.
    • support auto fill in folder path when create new sql to sync to D2(Internal version only).
    • support display multiply operation metric message in operation graph.
  • Bug Fix:
    • fix running job graph can't auto update bug.
    • Instance detail table support scroll selected row to visible view after re-sort.
    • editor hang when external table without resources.
    • jar is not supported to sync dataworks.
    • function is ambiguous with ().
    • udf run configuration column trim blank.
    • use gutter button to execute explain statement bug.

Changes in Version 2.9.5:

  • New Feature:
    • Provide new designed table builders.
  • Enhancement:
    • Support user specify a job name when submit script.
    • Sql format enhancement: with statement, loop statement.
    • Auto detect base project when sync new sql to d2 (Alibaba internal only).
  • Bug Fix:
    • Drop view failed in studio project explorer.
    • Editor hang when writing external table sql without using resources.
    • Function return type in sql editor code completion.
    • Fix sync to D2 bug(Alibaba internal only).

Changes in Version 2.9.4:

  • New Feature:
    • Add resource and create function can sync to D2(Alibaba internal only).
    • Detect jdk version and suggest user update jdk.
  • Enhancement:
    • User can see MaxCompute job list in sql running log.
    • Add keystroke(shift ctrl F5) for meta sync.
  • Bug Fix:
    • Interactive query should not available for public cloud project now.
    • Fix login incompatible on different intellij version.
    • Fix bind odpscmd jdk version incompatible on different intellij version.
    • Fix repeatedly open console in studio.
    • Fix job graph bug.

Changes in Version

  • Bug Fix:
    • Show project and endpoint in MaxCompute project combobox.
    • Can't find resource bundle error in English environment.

Changes in Version 2.9.3:

  • New Features:
    • Support add project connection with same name(different endpoint).
    • Support scratch script file.
  • Enhancement:
    • Disable select result export.
    • Disable export result data in job detail.
    • Table select combobox editable in UDF run configuration.
    • Enhance sync meta performance and show user synced number.
    • Enhance job graph ui, change progress graph to four part to display percentage.
    • Support change edge type on job graph and fix node size when rerun job.
    • Update odpscmd to 2.9.1 and bind odpscmd start jdk with intellij boot jdk.
  • Bug Fix:
    • Create view statement mistake for console command.
    • Some bug fixes.

Changes in Version 2.9.2:

  • New Features:
    • Support execute console command in sql editor.
  • Enhancement:
    • Show task detail info in job graph.
    • Show schema info between tasks in job graph.
    • Format date column in sql query result table.
    • UDT 'new' keyword suggestion and highlighting.
  • Bug Fix:
    • Error highlighting broken in sql editor.

Changes in Version 2.9.1:

  • New Features:
    • UDT editor support.
  • Enhancement:
    • Scroll selected row to visible viewport after job detail table being sorted.
    • Query result table support sort by column type.
    • Display fuxi job layer first when open multiply fuxi job instance.
    • Support execute one statement with set.
    • Support sync big project.
    • Add summary tab in job detail.
    • Add I/O info between operators in job graph.
  • Bug Fix:
    • Get user profile may fail.
    • UI hang after user login.
    • Ddl job graph disappear after refresh.
    • NPE when new script has macro parameters.
    • Python UDF test tab character trim.
    • Exception when modify python udf main class name.

Changes in Version 2.9.0:

  • New Features:
    • Support interactive query in studio
    • Support Alipay projects (Using proxy for Alibaba internal version only)
    • Support User login and list related projects (Using SSO for Alibaba internal version only)
    • Support to inspect SQL and quick fix in editor
    • Support graph computing plugin development
  • Enhancement:
    • Remote debug performance enhancement(Alibaba internal version only)
    • Optimize job detail table view layout and latency display format
    • User can config column separator when import/export table
    • Data Preview and SQL Query Result table can select column; format the date column of data preview grid
    • Show function overload signatures in editor for code completion
    • Show progress bar for table data preview task and allow user to cancel it
    • Enhance integration with Dataworks (Alibaba internal version)
    • Remember recently opened logview file
  • Bug Fix:
    • Fix bugs in job graph (eagle eye disappear sometimes, remember select type on change graph level)
    • Remove error notification when opening table view in project explorer.
    • Fix editor highlight bug on Table Name in Function Parameter is not Highlighted
    • Some other fixes

Changes in Version

  • Enhancement:
    • optimize job graph performance and support display table node in operation graph
    • user can execute statement using the gutter icon
    • show builtin function by type
  • Bug Fix:
    • query must end with semicolon
    • select transform python support
    • odps flag duplicate key
    • builtin function annotator show wrong
    • find symbol for builtin function NPE
    • builtin functon CONCAT not shown when code completion

Changes in Version

  • Enhancement:
    • support python UDF develop in external studio version
    • format sql based on OdpsQl code style rule
    • support download complex type and record limit when local run UDF
    • support write unstructured unit test
    • with icon when code completion
    • show line number in query result view
    • order project name in project explorer
  • Bug Fix:
    • ManagedMessageLoader hang by unreachable network
    • should not appear in column context for code completion
    • ddl table and keyword 'IN' not shown for code completion
    • can't bind MaxCompute project with odps_config.ini
    • open specific entity should add table to project explorer if it not exists

Changes in Version

  • Bug Fix:
    • fix import table cause memory rise when data file is big
    • fix editor collapse in statement mode sometimes
    • fix table not shown after project name and dot

Changes in Version 2.8.2:

  • New Features:
    • add table creation editor
    • support open logview by off-line file and save job as off-line file
    • record user sql history when submit script
  • Enhancement:
    • optimize instance detail table sort
    • use - to show I/O records on job graph when job is running
    • 2.0 builtin function document
    • sql editor performance
    • use ak account to create MaxCompute project connection
    • user can edit studio code template
    • auto import maven changes when new MaxCompute java module
    • show column type and function signature when hover the element in sql editor
    • show multi sql query result when submit script in statement mode
  • Bug Fix:
    • fix chinese garbled
    • fix data import bug
    • fix display job operation bug
    • show user original exception message when download resource failed

Changes in Version

  • Enhancement:
    • Hide pot details in Summary(JSON) tab.
    • Optimize project meta sync speed
    • Compile script in background when click graph tab
    • Live template enhancement
    • Enable config for sql editor keyword word-case
    • Optimize memory usage in job detail
  • Bugfix:
    • Fix job graph replay and heat map bug
    • Fixed active job list issue for public projects
    • Fixed testing project connection timeout issue
    • Fix some other bugs

Changes in Version

  • Enhancement:
    • Add IO bytes columns to job detail page
    • More smooth vertical scroll bar
    • Provide default endpoint when add MaxCompute project
    • Update job graph resouce bundle
    • Support zoom in/out function by mouse wheel
    • Truncate long operation message and use tooltip to display detail.
  • Bugfix:
    • Fix wrong display status in job detail page
    • and more...

Changes in Version 2.8.1:

  • New Features:
    • New job detail page integrated with timeline and analysis features
    • Visible table schema editor
    • New job graphs showing execution plan, progress, I/O data, and more.
    • New visual table schema editor
    • Table and function navigation
    • List builtin functions in project explorer
  • Enhancement:
    • Job details UI enhancement
    • Job progress view UI enhancement
    • Better code completion
    • Job queuing list UI enhancement
  • Bugfix:
    • Fix null pointer cased by DS_Store file
    • Fix no Deploy to server menu in windows
    • Fix max_pt function error in script editor
    • and more...