r - How to extract average ROC curve predictions using ROCR? -

-

the rocr library in r offer ability plot average roc curve (right rocr reference manual):

library(rocr) library(rocr) data(rocr.xval) # plot roc curves several cross-validation runs (dotted # in grey), overlaid vertical average curve , boxplots # showing vertical spread around average. data(rocr.xval) pred <- prediction(rocr.xval$predictions, rocr.xval$labels) perf <- performance(pred,"tpr","fpr") plot(perf,col="grey82",lty=3) plot(perf,lwd=3,avg="vertical",spread.estimate="boxplot",add=true)

averaged roc plot boxplot

lovely. unfortunately, there's seemingly no ability obtain average roc curve object/dataframe/etc. further statistical testing (say, proc). did research (albeit perhaps after fact), , found post:

global variables in r

i looked through rocr's code reveals following lines passing result plot:

performance_plots.r, (starting @ line 451)

## compute average curve  perf.avg <- perf.sampled  perf.avg@x.values <- list( rowmeans( data.frame( perf.avg@x.values)))  perf.avg@y.values <- list(rowmeans( data.frame( perf.avg@y.values)))  perf.avg@alpha.values <- list( alpha.values )

so, using trace function looked here (general suggestions debugging in r):

trace(.performance.plot.horizontal.avg, edit=true)

i added following line performance_plots.r after lines listed above:

perf.rocr.avg <<- perf.avg # note double `<<`

a horrible hack, yet works can plot perf.rocr.avg without problem. unfortunately, when using proc, can't compare averaged roc curve because requires proc roc object. that's fine, catch proc roc object requires original prediction , reference data create. far can tell, rocr averaging roc curves , not predictions, seems can't want out of rocr.

is there way reverse-engineer predictions averaged roc curve created rocr?


Comments

Post a Comment

Popular posts from this blog

javascript - Feed FileReader from server side files -

-
i´m starting customize/improve old audio editor project. can import audio tracks canvas via drag&drop computer. thing use audio tracks stored in server clicking on list of available tracks... instead of use <input type="file"> tags. how can read server side files filereader?ajax perhaps? in advance. this code file reader: player.prototype.loadfile = function(file, el) { //console.log(file); var reader = new filereader, filetypes = ['audio/mpeg', 'audio/mp3', 'audio/wave', 'audio/wav'], = this; if (filetypes.indexof(file.type) < 0) { throw('unsupported file format!'); } reader.onloadend = function(e) { if (e.target.readystate == filereader.done) { // done == 2 $('.progress').children().width('100%'); var onsuccess = function(audiobuffer) { $(el).trigger('audiee:fileloaded', [audiobuffer, file]); ...
Read more

How to Change swipe Tab Title color in java Android -

-
by default, view pager(swipe tabs) tab title color white want change orange. can 1 me please or share if have tutorial. thanks... use style in styles.xml , assign style tab layout. <style name="mymaterialtheme.tablayout" parent="widget.design.tablayout"> <item name="tabindicatorcolor">@android:color/white</item> <item name="tabindicatorheight">3dp</item> <item name="tabtextappearance">@style/mymaterialtheme.tablayout.textappearance</item> <item name="tabselectedtextcolor">@android:color/white</item> <item name="android:background">@color/colorprimary</item> </style> <style name="mymaterialtheme.tablayout.textappearance" parent="textappearance.design.tab"> <item name="android:textsize">14sp</item> <item name="android:textcolor">@color/tab_text_inactive</item> ...
Read more

Using globs in Perl replace one liner in TCL script -

-
i want run 1 perl 1 liner in tcl script below: exec perl -i -pe {s/substring/replacing_string/g} testfile; this works fine. but, if want modify files below: exec perl -i -pe {s/substring/replacing_string/g} *; it gives me error message: can't open '*': no such file or directory. while executing exec perl -i -pe {s/substring/replacing_string/g} *; i tried bracing '*', did not solve problem. requesting help... assuming files a , b , , c present in current working directory, executing echo * in shell prints a b c . because shell command evaluator recognizes wildcard characters , splices in list of 0 or more file names wildcard expression found. tcl's command evaluator not recognize wildcard characters, passes them unsubstituted command invoked. if command can work wildcards so. exec command doesn't, means pass wildcard expression shell command named command string. testing this, get % exec echo * * because asked shell exe...
Read more